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ABSTRACT 


The  neural  network  structures  developed  in  this  thesis 
demonstrate  the  ability  of  parallel  distributed  processing  in 
solving  adaptive  control  problems.  Adaptive  control  theory 
implies  a  combination  of  a  control  method  and  a  model 
estimation.  The  control  method  investigated  is  the  Lyapunov 
Model  Reference  Adaptive  Control  or  MRAC  and  the  model 
estimation  investigated  is  the  linear  least  square  estimator. 
The  neural  network  theory  is  introduced  with  emphasis  on  the 
back-propagation  algorithm.  The  implementation  of  the  neural 
network  adaptive  control  structure  is  demonstrated  on  the 
longitudinal  dynamics  of  the  X-29  fighter  aircraft.  Three 
configurations  are  proposed  to  train  the  neural  network 
adaptive  control  structures  to  provide  the  appropriate  inputs 
to  the  unstable  X-29  plant  so  that  desired  responses  could  be 
obtained.  These  configurations  are  presented  in  eight  cases, 
which  emulates  stable  systems  like  the  X-29  closed-loop  plant 
or  the  optimal  and  the  limited  X-29  controllers,  and  unstable 
systems  like  the  X-29  plant  or  its  inverse. 
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I.  INTRODUCTION 


The  parallel  distributed  processing  structure  of  neural 
networks  provides  the  models  for  solving  adaptive  control 
problems,  as  demonstrated  in  Ref.  1.  Adaptive  control  involves 
a  self-learning  controller  which  has  the  ability  to  adjust 
itself  in  order  to  compensate  for  system  changes.  The  control 
and  estimation  functions  of  adaptive  control  will  be 
implemented  on  the  H2  and  Ha,  controllers  and  on  the  plant  of 
the  X-29  [Ref.  2] . 

Three  configurations  are  proposed  for  training  the  neural 
networks  to  provide  the  appropriate  inputs  to  the  X-29  plant 
in  which  desired  responses  are  obtained. 

This  thesis  will  investigate  the  applications  of  methods 
that  are  based  on  neural  network  adaptive  control  theory  to 
the  reduced  order,  linearized  longitudinal  dynamics  model  of 
the  X-29  aircraft.  Chapter  II  introduces  neural  network  theory 
and  the  backpropagation  algorithm.  In  Chapter  III,  two 
traditional  adaptive  control  methods  will  be  briefly 
discussed,  a  one-step-ahead  control  algorithm  will  be  used  to 
design  the  control  model,  and  a  linear  least  square  estimation 
algorithm  will  be  implemented  to  design  the  estimator  model. 
Chapter  IV  presents  a  description  of  the  fighter  as  well  as 
the  H2  and  Hqo  controllers  that  were  designed  to  solve  the 
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subsonic  longitudinal  instability  of  that  aircraft.  Chapter  V 
describes  the  hardware  and  software  used  for  the  experimental 
set-up,  in  addition  to  model  design  considerations  which 
include  design  objectives,  model  structures  selection,  and 
configurations.  Chapter  VI  presents  the  results  of  the  three 
configurations'  simulations.  Finally,  Chapter  VII  concludes 
with  some  remarks  on  what  has  been  achieved  and  what  is 
recommended  for  further  studies. 
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II.  NEURAL  NETWORK  THEORY 

A.  ANALOGY  TO  THE  BRAIN 

Both  the  brain  and  the  digital  computer  operate  on 
electrical  signals,  perform  computational  functions  and  are 
composed  of  a  very  large  number  of  simple  elements.  The  major 
difference  is  in  the  signal  transmission  time  scale.  The 
computer  involves  microsecond  or  even  nanosecond  time  scales 
to  transmit  a  signal  compared  to  the  slow  nerve  impulses. 
Nevertheless,  the  advantage  of  the  brain  is,  that  its  huge 
computation  rate  is  achieved  by  an  enormous  amount  of  parallel 
units  which  surpass  any  modern  computer  system. 

Neural  network  elements  are  inspired  by  the  elementary 
functions  of  the  biological  neuron.  They  are  organized  in  such 
a  way  that  they  exhibit  some  characteristics  of  the  human 
brain.  That  is,  they  have  the  ability  to  learn  from 
experience,  to  perform  abstractions  of  inputs  with  relevant 
information,  and  to  generalize  their  knowledge  from  previous 
results. 

By  learning  we  mean  that  the  neural  network  can  modify  its 
behavior  from  the  environment's  response.  The  neural  network 
will  self-adjust  its  weights  to  produce  the  desired  output. 

By  abstraction  we  mean  the  ability  to  obtain  idealized 
prototypes  from  a  given  set  of  inputs. 
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By  generalization  we  mean  that  the  neural  network  trained 
on  input  and  output  examples  can  produce  a  reasonable  output 
to  an  input  differing  from  those  it  was  trained  on. 

Figure  1  shows  the  typical  neuron.  The  neuron  consists  of 
three  sections:  the  dendrites,  the  cell  body,  and  the  axon. 
[Ref.  3] 


dendrites 


Figure  l  Biological  Neuron 

The  dendrites  receive  signals  from  other  neurons  through 
the  synapses,  the  connection  points.  These  inputs  are 
multiplied  by  the  corresponding  weight,  the  synapse  strength, 
and  then  summed  in  the  cell  body  to  determine  if  their 
excitation  level  exceeds  the  specified  threshold.  On  the 
affirmative,  the  cell  fires  and  sends  a  signal  to  the  other 
neurons  through  the  axons. 
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B.  NEURAL  NETWORK  ARCHITECTURE 

In  a  neural  network,  we  refer  to  the  neuron  as  a 
processing  element,  PE.  As  shown  in  Fig.  2,  the  input  paths 
are  comparable  to  the  dendrites,  the  summation  operation  and 
the  transfer  function  to  the  cell  body,  and  the  output  paths 
to  the  axon.  [Ref.  4] 


Figure  2  Building  Blocks  of  Neural  Computing  Network 

1.  Processing  Elements 

A  processing  element  is  a  simple  computational  unit 
which  receives  data  from  its  input  side,  processes  that  data 
through  a  summation  operation  and  a  transfer  function,  and 
then  sends  the  result  to  the  neighboring  processing  elements 
from  its  output  side.  Figure  3  represents  a  simple  neural 
network  architecture.  Many  processing  elements  are  grouped 
into  layers  and  are  either  fully  or  randomly  connected  to  the 
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processing  elements  of  the  successive  layers.  These 
connections  determine  in  what  manner  the  processing  elements 
will  react  with  each  other. 

The  neural  networks  for  this  research  consist  of 
feedforward  networks  in  which  the  connections  feed  the 
information  in  only  one  direction.  No  recurrent  layers  or 
feedback  loops  from  a  processing  element  to  a  previous  one 
will  be  considered. 


Output 

buffer 


Hidden 

layer 


Input 

buffer 


Figure  3  A  Simple  Neural  Network  Architecture 


The  first  layer  is  the  input  buffer,  which  presents 
the  information  to  the  network.  The  last  layer  is  the  output 
buffer,  which  contains  the  response  of  the  network  to  the 
given  input.  Intermediate  layers  are  referred  to  as  hidden 
layers. 
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Referring  to  control  theory  in  state  space,  the  input 
buffer  elements  correspond  to  the  elements  of  the  input 
variable,  the  output  buffer  elements  to  the  ones  of  the  output 
variable,  and  the  hidden  units  to  the  elements  of  the  state 
variable . 

At  any  given  time,  each  processing  element  has  a 
certain  level  of  activation.  The  pattern  and  the  level  of 
these  activations  determine  the  state  of  the  system  at  that 
given  point. 

2.  Activation  function  Logic 

Neuralworks  Professional  II/  Plus®  development 
software  contains  an  activation  function  logic,  shown  in  Fig. 
4 ,  which  demonstrates  the  complexity  of  the  activation 
function  of  the  system.  The  use  of  complex  activation 
functions  may  help  the  network  to  solve  various  nonlinear 
systems.  Activations  may  include  a  summation  function,  a 
transfer  function,  a  noise  generator,  scaling,  limiting, 
thresholding,  and  an  output  function.  [Ref.  4] 

The  transfer  function  could  be  simply  a  linear,  or 
some  monotonic  function  like  the  sigmoid  and  hyperbolic 
tangent  functions.  A  nonlinear  network  can  be  achieved  by 
using  any  of  the  last  two  functions  since  they  provide 
nonlinear  responses. 
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Figure  4  Neural  networks  Professional  II 
Activation  Function  Logic 


The  sigmoid  function,  as  shown  in  Fig.  5,  is  a 
logistic  or  "squashing”  function.  NET  is  equivalent  to  x  in 
the  following  notation. 


;LCG!STIC  ruNCTION) 


Figure  5  Sigmoidal  Logistic  Function 


8 


The  sigmoid  function  is  expressed  as, 

OUT  =  1  /  (l+e~^)  (2.1) 

Its  derivative  can  be  simply  represented  in  terms  of  itself, 

OUT'  =  e~^/  (l+e~^)^ 

or  OUT' (X)  =  out (X) * (1-out (X) )  (2.2) 

which  saves  a  large  amount  of  computation  time.  Eguation  (2.2) 
defines  a  nonlinear  gain  that  solves  the  noise-saturation 
dilemma  of  Grossberg  (1973);  that  is,  it  permits  the  network 
to  handle  both,  small  and  large  signals.  The  central  region  of 
high  gain  helps  the  small  input  signals  to  be  processed,  while 
the  decreasing  slope  or  gain  at  both,  negative  and  positive 
extremes,  are  adequate  for  large  signals. 

Another  nonlinear  activation  function  which  is  often 
used  is  the  hyperbolic  tangent  function  shown  in  Fig.  6.  It  is 
expressed  as  follows: 

OUT  =  tanh(x)  or  OUT  =  (e*-e“^;  /  (e^+e"*;  (2.3) 
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Figure  6  Hyperbolic  Tangent  Function 

As  with  the  sigmoid  function,  its  derivative  can  also  be 
expressed  in  terms  of  itself: 

OUT' (X)  =  ( l+out(x})* (1-out (X) )  (2.4) 

3 .  Learning  rule 

There  are  two  distinct  phases  in  the  operation  of  the 
network:  learning  and  recall.  Three  types  of  learning  exist: 
supervised,  unsupervised,  and  reinforcement. 

Supervised  learning  involves  modifying  the  connection 
weights  in  response  to  a  desired  output  presented  to  the 
network  corresponding  to  a  given  input.  In  this  thesis,  the 
generalized  delta  learning  rule  was  selected  to  reduce  the 
error  between  the  actual  and  desired  output  of  a  processing 
element. 

If  the  network  is  not  given  any  desired  output,  an 
unsupervised  learning  process  applies.  The  network  forms 
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groups  of  similar  input  patterns,  where  each  processing 
element  responds  strongly  to  different  groups. 

Self-supervised  learning  falls  between  the  supervised 
and  the  unsupervised  learning.  The  network  will  determine  its 
own  desired  solution  and  trains  itself  accordingly. 

4.  Recall  rule 

Recall  is  a  simple  feedforward  network  where  no 
learning  takes  place,  i.e.,  no  feedback  between  layers.  An 
input  is  presented  to  the  network,  the  information  is 
propagated  forward  through  the  different  layers,  and  an  output 
is  obtained.  It  is  a  straightforward  process,  where  only  the 
summation  operation  and  the  transfer  function  apply.  It  is  an 
integral  part  of  the  testing  process  which  compares  the 
desired  and  the  actual  output  of  the  network  to  determine  the 
current  error. 

C .  BACK-PROPAGATION  ALGORITHM 

The  supervised  learning  rule  and  the  back-propagation 
algorithm  were  chosen  for  the  networks  of  this  investigation. 
Back-propagation  has  a  particular  way  of  handling  errors.  It 
distributes  the  error  by  propagating  the  output  error  backward 
through  the  connections  of  the  previous  layers. 

When  the  signal  is  fedforward  from  the  input  to  the 
output,  the  error  between  the  desired  and  actual  output  is 
obtained.  This  error  is,  then,  multiplied  by  the  derivative  of 
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the  transfer  function,  and  backpropagated  from  the  input  to 
the  output  layer  to  adjust  or  update  the  connections'  weight. 

The  typical  neural  network  using  the  back-propagation 
algorithm  is  best  represented  with  an  input  layer,  an  output 
layer,  and  at  least  one  hidden  layer  using  a  monotonic 
activation  function.  [Ref.  4:pp.  NC112] 

For  a  better  understanding  of  the  next  sections,  a  clear 
notation  is  necessary.  The  superscript  in  brackets  symbolizes 
the  layer  being  considered, 

Xj[s]  :  current  output  state  of  jth  neuron  in  layer  s, 
Wj^[s]:  weight  on  connection  joining  ith  neuron  in  layer 
s-1  to  jth  neuron  in  layer  s, 

Ij[s]  :  weighted  summation  of  inputs  to  jth  neuron  in 
layer  s. 

1.  The  Global  Error  Function 

The  learning  process  has  the  aim  of  minimizing  the 
global  error,  E,  by  adjusting  the  weights  in  the  network. 
Therefore,  the  measure  of  the  global  error,  E,  is  achieved  by 
subtracting  the  desired  output  d  by  the  actual  output  o,  as 
follows: 

E  =  0.5*i:(  (dj-Oj)^)  (2.5) 

Where  the  term  in  parentheses  is  the  raw  local  error.  The 
global  error  function,  E,  is  also  a  differentiable  function  of 
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all  connection  weights  in  the  network.  The  derivative  of  E 
with  respect  to  I  gives, 

eJs]  =  (2.6) 

The  raw  local  error  of  equation  (2.5)  is  scaled  by  multiplying 
it  by  the  derivative  of  the  transfer  function,  or 

Cj.  =  -dE/dljf^^  (2.7) 

=  -(dE/dOj)*(dOj/dIj) 

=  (dj-Oj)*f(Ij) 

The  scaled  local  error,  which  is  backpropagated,  will  be 
stored  in  each  processing  element  in  its  error  field. 

A  gradient  descent  rule  is  used  to  determine  if  an 

increment  or  decrement  of  the  current  weights,  ,  is 

favorable  to  reduce  the  global  error.  The  result  by  using  the 
chain  rule  and  equation  (2.6)  is, 

dE/dWj^l^}  =  (dE/dIjl^^)*(dIjt^}/dWjJs}^  (2.8) 

The  gradient  descent  rule  used  is, 

=  -Icoef*  (dE/dWj^i^J )  (2.9) 
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where  Icoef  is  the  learning  coefficient  or  rate. 

Combining  equations  (2.8)  and  (2.9)  gives, 

(2.10) 

The  error  signal,  e^-^®-^,  of  the  above  equation  is  applied  only 
to  the  elements  of  the  output  layer. 

As  to  the  elements  of  the  hidden  layers  which  do  not 
have  any  desired  output,  is  expressed  as  the  derivative 

of  the  transfer  function  multiplied  by  the  error  and  the 
weights  backpropagated  from  the  previous  layer,  or 

=  f  )  (2.11) 

2 .  Back-propagation  summary 

The  input  layer  will  be  presented  with  some  data  which 
the  network  will  propagate  in  a  straightforward  sense 
(feedforward)  to  the  output  layer.  At  the  same  time,  all  the 
summed  inputs,  Ij[s],  and  output  states,  Xj[s],  will  be  set 
for  each  processing  element. 

For  the  output  layer,  the  scaled  local  error  from 
equation  (2.7)  and  the  delta  weight  of  equation  (2.10)  will  be 
calculated  for  each  of  its  processing  elements. 

For  the  hidden  layers,  the  scaled  local  error  will  be 
calculated  using  equation  (2.11)  and  the  delta  weight  using 
also  equation  (2.10). 
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An  update  of  all  the  weights  will  be  performed  by 
adding  these  delta  weights  to  their  corresponding  previous 
weights.  [Ref.  4;pp.  NC116] 
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ADAPTIVE  CONTROL  SYSTEMS 


An  adaptive  controller  is  one  in  which  the  control  system 
has  the  ability  to  adjust  itself  in  order  to  compensate  for 
some  changes  in  the  system's  parameters  and  environment. 
Adaptive  control  is  divided  into  two  functions:  a  control 
function  and  a  model  estimation  function. 

The  design  of  an  adaptive  control  system  can  be 
conceptually  simple  when  combining  a  particular  parameter 
estimation  technique  with  any  control  law. 

In  this  chapter,  two  traditional  adaptive  control  methods 
will  be  briefly  discussed,  a  one  step  ahead  control  algorithm 
will  be  used  to  design  the  control  model,  and  a  linear  least 
square  estimation  will  be  implemented  with  a  recursive  least- 
squares  algorithm  to  produce  a  predictor-corrector  equation 
used  to  design  the  estimator  model. 

A.  TWO  TRADITIONAL  ADAPTIVE  CONTROL  METHODS 

There  are  two  traditional  adaptive  control  methods  that 
are  of  interest  to  neural  network  control  theory:  the  self- 
tuning  regulator  of  Astrom  (STR)  and  the  Lyapunov  model 
reference  adaptive  control  (MRAC) .  The  self-tuning  regulator 
block  diagram  is  shown  in  Fig.  7.  It  is  a  classical  feedback 
system  with  on-line  adjustable  coefficients.  [Ref.  5] 
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Figure  7  Self-Tuning  Regulator  Control  Block  Diagram 

For  the  approximation  of  the  model  that  describes  the 
system  being  controlled,  a  least  squares  error  parameter 
identification  technique  is  used.  The  regulator  parameters  are 
adjusted  during  each  control  cycle  according  to  the  best 
estimate  of  the  system  parameters. 

With  this  method,  the  stability  of  the  system  is  not 
always  guaranteed.  During  the  learning  phase  the  input  signal 
can  become  infinitely  large,  thus  the  model  is  not  realizable. 
If  the  least-squares  error  parameter  estimates  do  not  match 
entirely  the  description  of  the  system,  the  closed-loop  system 
performance  will  not  satisfy  the  design  specifications. 

The  second  adaptive  control  method  is  the  Lyaponuv  model 
reference  adaptive  control  (MRAC) ,  shown  in  Fig.  8.  The  system 
is  forced  to  follow  a  reference  model.  [Ref.  5] 
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The  regulator  consists  of  two  loops,  an  inner  and  an  outer 
loop.  The  inner  loop  is  a  feedback  loop  composed  of  the 
regulator  and  the  plant. 


Figure  8  Model  Reference  Adaptive  Control  Block  Diagram 

The  outer  loop  is  also  a  regulator  loop.  It  adjusts  the 
parameters  of  the  regulator  by  minimizing  the  error  between 
the  plant  output  y  and  the  model  output  y^.  Therefore,  the  aim 
is  to  determine  the  adjustment  mechanism  so  that  the  system 
being  controlled  tracks  perfectly  the  reference  model  with 
zero  error. 

The  latter  type  of  adaptive  controller  will  be  emphasized 
in  this  thesis. 
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B.  ONE  STEP  AHEAD  PREDICTION  CONTROL 


The  first  function  of  adaptive  control  is  control.  The 
one-step-ahead  controller  is  a  very  simple  form  of  a  control 
law.  The  basic  idea  is  that  the  control  input  at  each  point  in 
time  is  determined  so  as  to  bring  the  output,  y^'t+d;  (where  d 
represents  a  time  delay),  to  a  desired  output  value,  y* (t+d) , 
in  one  step.  This  controller  works  not  only  for  linear  systems 
but  also  for  a  large  class  of  nonlinear  systems  [Ref.  6:pp. 
118-122] . 

The  input-output  properties  of  the  system  can  be  described 
by  three  equivalent  model  formats;  a  left  difference  operator 
representation,  an  observable  state-space  model,  or  a  DARMA 
(discrete  time  deterministic  autoregressive  moving  average) 
model  [Ref.  6;p.  120].  The  simplest  to  use  for  the  development 
of  adaptive  control  algorithms  is  the  (DARMA)  model.  That 
model  can  be  expressed  as, 

A(q)y(t)  =  B(q)u(t)  where  (3.1) 
A(q~h  =  I+Aj(q)  +  .  .  .+A„(q) 

B(q~h  =  B^+,.,+B„(q) 

where  A(q)  and  B(q)  are  matrix  polynomials  expressed  in  terms 
of  the  backward  shift  operator,  q~^ ,  the  system  output,  y(t), 
and  the  system  input,  uft).  The  terms  in  the  past  values  of  y 
are  the  autoregressive  components  and  the  terms  in  the  past 
values  of  u  are  the  moving-average  components.  A  DARMA  model 
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can  be  compared  to  a  controllable  and  observable  state-space 
model  with  an  arbitrary  initial  state,  or  simply  a  transfer 
function.  [Ref.  6:p.  32] 

Rearranging  equation  (3.1)  by  expanding  a  single  input 
single  output  (SISO)  DARMA  model  in  the  shift  operator  gives, 

y(t)  =  biU(t-l)+b2U(t-2)+. . .-aiy(t-l}-a2y(t-2) . . .  (3.2) 

which  can  be  used  to  predict  the  output  at  the  next  time  step, 

y*  (t+1)  =  biU(t)+b2U(t-l)  +  . .  .-aiy(t)-a2y(t-l)  . . .  (3.3) 

where  y*  (t+1)  is  the  predicted  value  of  y(t+l).  The  control 
input,  u(t),  of  equation  (3.3),  which  brings  the  system  to  a 
desired  value  y*(t+l)  in  one  step,  can  be  solved  as  follows: 

u(t)  =  1/bj  [y*(t+l)+ajy(t)+a2y(t-l)  +  ... 

-b2U(t-l)  . . .]  (3.4) 


where  the  term  y*  (t+l)  could  be  some  reference  input  to  the 
system  [Ref.  l:p.  19]. 

The  one  step  ahead  prediction  control  law  equation  (3.4) 
minimizes  the  quadratic  cost  function  comprising  the  squared 
prediction  error: 

J(t)  =  1/2  [y(t+l}-y*  (t+1)  (3.5) 
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Excessive  effort  may  be  required  to  bring  y(t+l)  to 
y*  (t+1)  in  one  step.  Therefore,  some  generalized  cost 
functions  of  the  same  form  like  the  weighted  one- step- ahead 
controller  [Ref.  6:p.  122],  described  below,  could  achieve  a 
compromise  between  the  level  of  effort  expended  and  the 
prediction  error. 

If  the  past  values  of  y(t)  and  u(t)  are  state  variables, 
the  one  step  ahead  controller  becomes, 

u(t)  =  K(t)x(t)-^r(t)  (3.6) 

which  is  a  state  variable  feedback  with  r(t)  as  the  reference 
input  controller.  From  equation  (3.4),  the  vector  of  past 
outputs  and  inputs  provides  the  state  variables  in  equation 
(3.6)  which  in  turn  provides  a  controller  for  an  adaptive 
algorithm  [Ref.  6:pp.  120-170],  This  one  step  ahead  controller 
could  easily  be  modified  to  represent  a  weighted 
sura  of  state  variables  and  a  reference  input,  i.e.,  a  weighted 
one-step-ahead  controller, 

u(t)  =  Ej-  Wjj*Nj(t)  (3.7) 

where  Nj(t)=[  r(t)  u(t-l)  u  (t-2 )  . .  .-y  (t)  -y(t-l)  -y(t-2)...] 
As  mentioned  in  the  chapter  of  neural  network  theory,  the 
input  to  a  processing  element  is  defined  as  the  weighted  sum 
of  all  the  element  activations  coming  to  its  input,  as  shown 
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in  Fig.  2.  Therefore,  a  direct  comparison  could  be  made 
between  the  two  previous  statements,  in  that  this  form  of 
controller  may  well  be  represented  by  neural  network 
processing  elements. 

C.  LINEAR  LEAST  SQUARE  ESTIMATION 

The  second  function  of  adaptive  control  is  estimation.  On¬ 
line  estimation  techniques  provide  estimates  for  the  system 
parameters  based  on  minimizing  the  quadratic  cost  functions  as 
in  the  case  of  a  one-step-ahead  controller. 

The  input-output  characteristics  of  many  linear  and 
nonlinear  deterministic  systems  may  be  described  by  the 
following  model  [Ref.  6;p.  50]: 

y(t)  =  N(t-l)e^  (3.8) 

where  y(t)  denotes  the  system  output 

N(t-l)  denotes  a  regression  vector  containing  past 
measurements  of  the  input  and  output, 

0  denotes  a  parameter  vector. 

A  fir sc  order  DARMA  model  can  be  represented  by  [Ref.  6:p. 
50], 

y(t)  =  Z  bjU(t-j)-  Z  a^y(t-k)  (3.9) 
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where  j  and  k  are  indices  for  past  input  and  output 
measurements.  Equation  (3.9)  can  be  expressed  in  the  form  of 
equation  (3.8)  as  follows: 

N(t-l)  =  [u(t)  u(t-l)  u(t~2)  .  .  .-y(t~l)-y(t-2)  .  .  .]  (3.10) 

^  ~  ^ 2^ 3 "  *  (^*11) 

With  equation  (3.9)  the  prediction  error  becomes, 

^(t,e)  =  y(t)-N(t-l)e'^  (3.12) 

where  €  is  used  in  the  quadratic  cost  function  to  determine 
some  optimal  value  for  6  [Ref.  7:pp.  176-179], 

J(e)  =  1/2  (3.13) 

where  t  covers  1  to  n  measurements.  Equation  (3.13)  can  be 
minimized  analytically  by  differentiating  with  respect  to  0 
and  setting  the  result  equal  to  zero,  which  on  solving  for  6 
gives  the  linear  least  square  estimate, 

e  =  [1/n  ll^N(t)N'^(t)r^  1/n  i:^N(t)y(t)  (3.14) 

where  0  is  the  estimated  parameter  vector,  equation  (3.11). 
The  recursive  least-squares  algorithm  [Ref.  7:p.  307] 
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summarizes  in  five  equations  the  way  of  determining  the 
parameter  vector,  6, 

e(t+l)  =  Q(t)+L(t)  [y(t)-Q^(t)N(t-l)  ]  (3.15) 

L(t)  =  P(t~l)N(t-l)  [l+N^(t-l)P(t-l)N(t-l)  ]-^ 

P(t)  =  P(t-l)-[A(P,N,t)/B(P,N,t)] 

A(P,N,t)  =  P(t-l)N^(t-l)N(t-l)P(t-l) 

B(P,N,t)  =  l  +  [N^(t-l)P(t-l)N(t-l)  ] 

The  first  equation  of  (3.15)  is  a  predictor-corrector 
equation,  while  the  others  solve  for  the  estimation  gain, 
L(t)  . 

A  special  form  of  a  predictor-corrector  equation  that  is 
used  in  many  least-squares  parameter  estimation  applications 
is  expressed  as  follows:  [Ref.  6:p.  49] 

6(1+1)  =  0(t)+M(t)N(t-l)e(t)  (3.16) 

where  6(t)  denotes  the  parameter  estimate  at  time  t 

M(t)  denotes  an  algorithm  gain  (possibly  a  matrix) 
N(t-l)  denotes  the  regression  vector 
e(t;  denotes  the  model  prediction  error 
The  gain  term,  M(t),  may  vary  from  a  scalar  constant  to  a 
covariance  matrix,  as  seen  in  equation  (3.15)  with  L(t) . 
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From  the  back-propagation  learning  rule  discussed  in  the 
previous  chapter,  equation  (2.10)  is  very  similar  to  the 
linear  least  squares  parameter  estimator,  equation  (3.16), 

(2.10) 

The  learning  coefficient,  Icoef,  is  equivalent  to  the 
algorithm  gain,  M(t)  ;  the  error  signal,  e^-,  is  equivalent  to 
the  model  prediction  error,  e(t)j  and  the  activation  value, 
is  equivalent  to  the  regression  vector,  N(t-l).  Thus,  a 
neural  network  using  the  back-propagation  algorithm  is  in  a 
sense  a  linear  least  squares  estimator  [Ref.  7:p.  22].  The 
algorithms  and  theorems  applicable  to  the  linear  least  squares 
estimation  should,  for  the  most  part,  be  applicable  to  the 
back-propagation  neural  network. 

In  summary,  adaptive  control  is  a  combination  of  a  control 
method  and  a  model  estimation.  For  the  control  method,  the 
Model  Reference  Adaptive  Control  (MRAC)  was  chosen  over  the 
Self-Tuning  Regulator  (STR) .  As  to  the  controller  itself,  the 
weighted  one  step  ahead  prediction  controller  was  defined  as 
the  weighted  sum  of  the  state  variables  and  the  reference 
input.  These  weights  or  feedback  gains  are  extracted  from  the 
adjustment  mechanism  of  MRAC  in  Fig.  8  and  are  determined  by 
minimizing  the  error  between  the  network  predicted  output  and 
the  model  output. 
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For  the  estimation  model,  which  is  the  linear  least 
squares  estimate,  the  predicted  output  was  also  defined  as 
some  weighted  sum  of  the  terms  in  the  regression  vector.  This 
time,  the  weights  are  determined  using  the  predictor-corrector 
equation  to  minimize  the  error  between  the  measured  and 
predicted  output. 

By  combining  the  control  and  estimation  models  above,  it 
appears  that  the  back  propagation  learning  rule  could  produce 
models  for  adaptive  control  problems. 
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IV.  X-29  MODERN  AIRCRAFT 


The  purpose  of  this  chapter  is  to  present  a  description  of 
the  modern  aircraft  chosen  and  to  describe  the  and  Ha, 
controllers  that  were  previously  designed  to  solve  the 
instability  of  that  aircraft.  The  model  used  is  the  subsonic 
longitudinal  dynamics  of  the  X-29  fighter  aircraft.  The  X-29 
is  a  single  seat  forward  swept  wing  (FSW)  demonstrator 
aircraft  built  by  the  Grumman  Corp.  The  FSW  design  offers  a 
new  generation  of  tactical  aircraft  that  is  smaller,  lighter 
in  weight,  less  costly,  and  highly  efficient. 

A.  FIGHTER  DESCRIPTION 

The  aerodynamic  advantages  of  a  forward  swept  wing  have 
been  known  since  the  1940 ’s.  These  advantages  are:  improved 
maneuverability  with  spin-proof  characteristics,  better  low- 
speed  handling,  and  reduced  stalling  speed.  Another  important 
advantage  is  the  low  drag  across  the  entire  operational 
envelope,  particularly  around  the  sonic  speed,  which  permits 
the  use  of  a  less  powerful  engine  [Ref.  8].  The  FSW  design  is 
expected  to  reduce  the  transonic  drag  about  20%,  and  to 
handle  low  speeds  and  high  angles  of  attack  much  better  than 
any  aft-swept  wing  [Ref.  8:pp.  47].  However,  no  suitable 
structure  could  be  found  in  the  1940 ’s  to  take  full  advantage 
of  these  benefits.  Only  years  later,  did  the  use  of  advanced 
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composite  materials  offer  a  solution.  The  graphite  composite 
material,  strong  and  light  in  weight,  was  utilized  on  the  FSW 
to  eliminate  the  adverse  static  aeroelastic  coupling  between 
wing  bending  and  torsion.  The  X-29,  shown  in  Figure  9, 
features  close-coupled  canard  surfaces  in  front  of  the 
forward-swept  wings  for  primary  pitch  control.  [Ref.  9] 


The  small  strake  flaps  at  the  rear  of  the  aircraft  provide 
additional  pitch  at  low  speed. 

To  optimize  the  wing  for  various  flight  conditions,  the 
wing's  two  segment  trailing  edges  (flaperons)  behave  as  a 
variable  camber  device  for  pitch  control.  This  variable  camber 
control  will  permit  the  airplane  to  be  optimized  for  low 
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speed,  maneuvering,  cruising,  and  high-speed  flight 
conditions . 

The  X-29  longitudinal  dynamics  model  considered  in  this 
thesis  is  the  analog  reversion  mode  with  the  aircraft  trimmed 
at  0.5  mach,  30,000  feet.  The  original  83rd  order  model  was 
reduced  to  a  14  state  model.  The  reduced  model  includes  a 
short  period  approximation  of  the  aircraft  longitudinal 
dynamics,  the  vertical  velocity,  w,  and  pitch  rate,  g,  and  the 
fourth  order  actuator  dynamics  for  the  three  longitudinal 
control  surfaces,  i.e.,  the  canards,  flaperons  and  strakes. 

Figure  10  shows  the  open  loop  actuator/aircraft  dynamics 
model  of  the  X-29  [Ref.  2].  The  two  separated  commands,  rj  and 
r^,  are  the  input  to  the  three  control  surface  actuators  with 
rj  controlling  the  canards  and  controlling  the  flaps  and 
strakes.  The  outputs  of  the  system  are  the  two  states,  v  and 
g.  The  w-state  becomes  the  angle  of  attack  a  when  divided  by 
the  initial  forward  velocity  U^.  Therefore,  the  uncompensated 
model  has  two  inputs,  two  outputs,  and  14  states.  The  control 
inputs  to  the  aircraft  dynamics  are  the  canards  6^,  the 
flaperons  6f,  the  strakes  Sg  and  their  respective  first  and 
second  derivatives. 

The  uncompensated  state  variables  are  listed  in  Table  I, 
and  the  open  loop  poles  are  listed  in  Table  II.  Notice  the 
positive  pole,  1.9550,  on  the  real  axis,  meaning  that  the  X-29 
has  an  unstable  short  period  mode. [Ref.  2] 
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TABLE  I  :  UNCOMPENSATED  X-29  MODEL  STATES 


State 

DescriDtion 

Units 

a 

angle-of -attack 

rad 

q 

pitch  pate 

rad/sec 

canard  control  input 

rad 

flap  control  input 

rad 

strake  control  input 

rad 

canard  control  rate 

rad/sec 

flap  control  rate 

rad/sec 

K 

strake  control  rate 

rad/sec 

K 

canard  control  accel. 

rad/sec^ 

flap  control  accel. 

rad/sec^ 

strake  control  accel. 

rad/sec^ 

canard  control  jerk 

le+04  rad/sec* 

flap  control  jerk 

le+04  rad/sec* 

strake  control  jerk 

le+04  rad/sec’ 

TABLE  II 

:  UNCOMPENSATED  X-29 

OPEN-LOOP  POLES 

-2.2746e+02  ±  2.3201e+02i 
-1.4491e+02 
-1.4455e+02 
1.9550e+00 
-1.0031e+02 
-2.7155e+00 

-5.2506e+01  ±  4.8410e+01i 

-5.2518e+01  ±  4.8255e+01i 

-5.0067e+01 

-2.01726+01 

-2.01156+01 
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B.  MID  CONTROLLERS 

The  uncompensated  X-29  model  possesses  poor  disturbance 
attenuation,  high  sensitivity  to  plant  variations  and  modeling 
errors,  and  a  small  control  bandwidth. 

Three  weighing  functions  were  utilized  in  Ref.  2  to 
improve  these  performance  characterizations  by  suppressing  the 
sensitivity  function  singular  values  as  much  as  possible, 
i.e. ,  to  make  the  loop  gains  as  large  as  possible  over  a  wider 
bandwidth.  The  resultant  X-29  augmented  plant  is  a  16th  order 
system,  in  which  the  weighing  functions  added  two  states. 

The  two  Riccati  solution  methods  mentioned  in  Ref.  2 
indicate  that  H2  and  Ha,  controllers  must  be  the  same  size  as 
the  augmented  plant.  Therefore,  the  X-29  controller  has  to  be 
of  16th  order.  As  a  result,  the  Ha,  compensated  X-29  has  a 
larger  disturbance  attenuation,  lower  sensitivity  to 
variations  and  modelling  errors,  and  a  wider  control 
bandwidth.  [Ref.  2] 

Two  Hoo  and  H2  controllers  have  been  designed  to  represent 
the  optimal-performance  and  the  limited-  performance  models. 

The  closed-loop  architecture  for  the  Hq,  compensated  X-29 
is  shown  in  Fig.  11.  The  first  block  is  the  16th  order 
controller  and  the  second  block  the  14th  order  plant  matrix. 
[Ref.  2:p.  62] 
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Closed-Loop  Architecture 


cl 

U 

Plant 

V 

f 

Y 

Controller 

A 

Figure  11  Closed-Loop  Model  of  the  Hq,  Compensated  X-29 

Unlike  the  open  loop  actuator/aircraft  dynamics  model  of 
Fig.  10,  the  command  vector  r,  composed  of  elements  and  r2, 
represents  the  reference  commands  for  the  controlled  outputs, 
a  and  q.  The  controllers  have  been  placed  in  series  with 
the  fighter  plant  to  be  fed  backward  with  a  negative  gain  of 
one.  Therefore,  the  closed-loop  system  has  two  inputs,  two 
outputs  and  thirty  states. 

The  longitudinal  equations  of  motion  may  be  expressed  in 
the  following  state  variable  form: 

x(t)  =  Ax(t)  +  Bu(t)  (5.1) 

y(t)  =  Cx(t)  +  Du(t) 

where  x(t)  contains  the  state  variables  of  the 
controller  and  of  the  X-29  plant. 
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u.(t) 


contains  the  input  variables  r^ft;  and 
r2(t)  ,  and 

yi(t)  contains  the  output  variables  a(t)  and 

<?rt; . 

1.  Optimal-Performance  Model  (Compensated) 

The  Matlab  program  used  to  obtain  the  closed-loop 
state  space  representation  of  the  optimal-performance  model 
is  described  in  Ref.  2  pages  115  to  121. 

The  poles  of  the  closed-loop  model  are  listed  in 
Table  III.  The  unstable  short  period  pole,  1.9550,  of  the 
open-loop  system  in  Table  II  is  mirrored  into  the  left  half 
plane  in  Table  III. 

Safonov  [Ref.  11]  indicates  that  this  mirror  imaging 
does  not  cause  any  limitation  to  the  system's  performance  if 
this  pole  is  not  the  dominant  one. 

The  compensated  X-29  model  provides  precision  flight 
path  control  modes  due  to  the  multiple,  independently 
controlled  surface  configuration.  Figure  12  shows  a  graphic 
representation  of  these  precision  control  modes, 

where  a  denotes  angle-of -attack, 

0  denotes  pitch  attitude, 

y  denotes  flight  path  angle. 
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TABLE  III  :  X-29  OPTIMAL  PERFORMANCE  CLOSED-LOOP  POLES 


-4 . 1327e+02 
-2.2745e+02  ± 
-1.3068e+02  ± 
-5.3305e+01  ± 
-1.4491e+02 
-1.4452e+02 
-1.3014e+02 
-1.3877e+01  ± 
-9.9794e+01 
-5.2545e+01  ± 
-5.2503e+01  ± 
-7 . 4132e+01 
-1.9550e+00 
-2 . 7155e+00 
-2.0379e+01  ± 
-2.0578e+01  ± 
-4.9199e+01  ± 
-4 .2465e+01 
-2 . 0184e+01 
-2 . OllOe+01 


2.3201e+02i 
4 .6111e+01i 
8.9700e+01i 


5.9243e+01i 

4 .8359e+01i 
4.8301e+01i 


2.1564e+01i 

1.8907e+01i 

6.5316e+00i 


Xp  and  s  denote  the  aircraft  principal  and 
stability  axes. 


The  three  precision  longitudinal  inodes  observed  are  [Ref. 12]: 

1.  Vertical  Translation:  The  aircraft's  vertical  velocity  is 
controlled  at  a  constant  6  by  varying  a  ,i.e.,  the 
aircraft's  flight  path  angle,  y,  or  velocity  vector,  is 
controlled  while  Xs  remains  fixed. 

2.  Direct  Lift  Control:  The  aircraft's  flight  path  angle,  y, 
is  controlled  at  a  constant  a  by  varying  d,  i.e.,  the 
aircraft's  flight  path  angle,  y,  or  velocity  vector, 
remains  along  the  aircraft's  axis  Xp  as  Xs  rotates. 

3.  Pitch  Pointing:  The  aircraft  pitch  attitude,  6,  is 
controlled  at  a  constant  flight  path  angle,  y,  i.e.,  the 
aircraft's  flight  path  angle,  y,  or  velocity  vector 
remains  fixed  while  Xs  rotates  (0=a) . 
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Figure  12  Precision  Control  Modes 


a.  Time  Domain 


The  longitudinal  motion  of  the  X-29  is  described 
in  time  and  frequency  domains.  For  the  time  domain,  a  pulse 
input  of  one  degree  was  applied  for  one  second  to  each  of  the 
two  reference  commands.  The  a(t)  and  g(tj  time  responses  of 
the  compensated  X-29  for  input  1,  ri,  and  for  input  2,  r2,  are 
shown  in  Fig.  13  and  14. 

The  vertical  translation  mode  is  represented  by 
Fig.  13  in  which  input  1  separates  q  and  d  from  a.  It  follows, 
that  there  are  negligible  changes  in  q  (order  of  magnitude  10” 
compared  to  a,  which  has  a  fast  response  of  0.180  sec. 

The  direct  lift  control  mode  is  represented  by 
Fig.  14,  in  which  this  time  input  2  separates  a  from  g.  The  X- 
29  responds  to  input  2  with  a  negligible  a  (order  of  magnitude 
10“^)  and  with  a  positive  g  rise  time  of  0.180  sec. 
b.  Frequency  Domain 

The  continuous  and  discrete  Bode  frequency 
responses  of  (x(t)  and  q(t)  for  input  1,  rl ,  and  for  input  2, 
r2,  are  shown  in  Fig.  15  through  18. 

The  discrete  frequency  responses  are  dominated  by 
short  period  modes.  For  convenience,  the  high  frequency 
dynamics  above  the  nyquist  frequency  have  been  removed  for  the 
subsequent  Bode  plots. 
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re  13  Q  and  a  Time  Responses  to  Input  1  (Optimal  case) 
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Figure  14  Q  and  a  Time  Responses  to  Input  2  (Optimal  case) 
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Altitude  =  30000  feet  frequency  (Hz)  Mach  =.5 

Figure  16  Continuous  and  Discrete  q  Frequency  Responses 
to  Input  1  (Optimal  case) 


magnitude 


Altitude  =  30000  feet  frequency  (Hz)  Mach  =.5 


Figure  17  Continuous  and  Discrete  a  Frequency  Responses 
to  Input  2  (Optimal  case) 


Altitude  =  30000  feet  frequency  (Hz)  Mach  =.5 


Figure  18  Continuous  and  Discrete  q  Frequency  Responses 
to  Input  2  (Optimal  case) 


2.  Limited-performance  Model 


The  limited-performance  X-29  can  be  characterized  by  a 
smaller  control  and  closed  loop  bandwidth,  a  larger 
sensitivity  to  plant  variations  and  modeling  errors,  and  a 
smaller  disturbance  attenuation  [Ref.  2:p.  87]. 

The  Matlab  program  used  to  obtain  the  closed  loop  state 
space  representation  of  the  Ho,  limited-performance  model  is 
described  in  Ref.  2  pages  115  to  121.  The  closed  loop  poles 
are  listed  in  Table  IV.  Notice  that  the  same  unstable  short 
period  pole,  1.9550,  of  the  open  loop  system  is  mirrored  into 
the  left  half  plane. 


TABLE  IV  :  X-29  LIMITED  PERFORMANCE  CLOSED-LOOP  POLES 


-2.2747e+02 
-1. 3612e+02 
-1.4415e+02 
-1.4494e+02 
-1.4476e+02 
-l,0023e+02 
-5.1688e+01 
-7.2313e+01 
-3.7606e+01 
-5.1716e+01 
-5.3298e+01 
-5.2512e+01 
-5.0505e+01 
-3.6342e+01 
-1.1889e+01 
-I.9539e+00 
-2.7204e+00 
-3.7372e+00 
-9.6752e+00 
-2.0387e+01 
-2.1180e+01 


±  2.3201e+02i 


±  7.7445e+0li 

±  5.2777e+0li 
±  5.0560e+0li 
±  4.7220e+01i 
±  4.8306e+01i 


±  1.2160e+01i 


±  1.1180e+00i 
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a.  Time  Domain 


As  in  the  optimal  performance  case,  a  step  input  of 
one  degree  for  one  second  was  applied  to  each  of  the  two 
reference  commands. 

The  a(t)  and  q(t)  time  responses  of  the  limited- 
performance  X-29  for  input  1,  r^,  and  for  input  2,  r^,  are  in 
Fig.  19  and  20.  The  separation  of  a  and  q  responses  in  both 
inputs  are  not  as  pronounced  as  in  the  compensated  X-29  case. 
The  step  inputs  with  rise  times  of  0.5  sec  and  0.8  sec  to 
input  2  indicate  that  the  limited-performance  model  was  slower 
to  react  ,i.e.,  it  is  the  result  of  a  smaller  closed  loop 
bandwidth  [Ref.  2:p.  93]. 

Therefore,  the  precision  flight  path  modes  in  the 
case  of  the  limited-performance  X-29  are  not  as  fully 
accomplished  as  the  optimal-performance  case. 

b.  Frequency  Domain 

The  continuous  and  Bode  frequency  responses  of  a(t) 
and  q(t)  for  input  1  and  2  are  shown  in  Fig.  21  through  24.  As 
in  the  optimal  performance  model,  the  high  frequency  range  was 
limited  to  50  hertz. 
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SEC  and  DEGREES 


TIME  -  SEC 


Figure  19  Q  and  a  Time  Responses  to  Input  1  (Limited  case) 
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Figure  20  Q  and  o  Time  Responses  to  Input  2  (Limited  case 
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fure  21  Continuous  and  Discrete  a  Frequency  Responses 
to  Input  1  (Limited  case) 
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Figure  24  Continuous  and  Discrete  q  Frequency  Responses 
to  Input  2  (Limited  case) 
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V.  EXPERIMENTAL  SET-UP 


In  this  chapter,  a  description  of  the  hardware  and 
software  used  for  the  experimental  set-up  of  the  neural 
network  adaptive  control  will  be  given.  Model  design 
considerations  will  follow  which  include  design  objectives, 
model  structure  selections,  and  choices  of  configurations. 
These  configurations  will  be  demonstrated  with  eight  cases 
which  are  the  framework  of  the  experiments  in  the  use  of 
neural  networks  in  adaptive  control. 

A.  HARDWARE  AMD  SOFTWARE  REQUIRED 
1 .  Hardware 

All  the  research  done  in  the  area  of  data  processing 
was  conducted  on  the  SPARC®  Station  2.  To  emulate  a  parallel 
distributed  processor  which  requires  a  very  large  memory 
capacity  and  high  speed,  the  choice  of  this  station  becomes 
apparent.  The  SPARC®  Station  2  uses  a  32-bit  architecture  with 
a  40  mHz  central  processing  unit.  Sun  4/75  CPU,  and  a  memory 
card  with  48  mBytes  of  RAM.  An  internal  hard  disk  drive  of  207 
mBytes  and  an  external  one  of  996  mBytes  were  added  to  the 
system. 

The  workstation  provides  a  multitasking  windowed 
graphical  environment,  which  greatly  enhances  the  system's 
flexibility  in  addition  to  the  powerful  UNIX  operation  system, 
Sun  OS  4.1.1. 
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A  16-inch  high  resolution  color  monitor,  a  0.25-inch 
cartridge  tape  drive,  and  a  3.5-inch  high  density  diskette 
drive  are  also  part  of  the  system. 

Overall,  the  station's  power  and  flexibility  prove  to 
be  as  important  as  its  memory  size  and  speed  [Ref.  12]. 

2 .  Software 

The  Neuralworks  Professional  II/PLUS  package  by 
Neuralware,  Inc  was  the  neural  networks  software  used. 
Neuralworks  requires  a  minimum  of  400  kBytes  of  base  memory  to 
operate,  and  offers  over  a  dozen  different  types  of  networks, 
from  the  historical  perception  and  the  brain-state-in-a-box, 
to  the  back-propagation  and  the  Boltzmann  machines. 

Neuralworks  has  a  user's  guide,  some  tutorials,  a 
quick  reference  index,  a  menu  listing,  and  many  features  of 
file  inputs  and  outputs.  It  supports  a  general  file  format  for 
inputting  or  outputting  data  to  or  from  the  network  from 
standard  spreadsheet  file  formats  such  as  Lotus  1-2-3  and 
Excel,  from  the  keyboard  interface  if  formatted  in  ASCII 
files,  or  from  user  defined  modules  written  in  the  C 
programming  language.  [Ref.  4:pp.  UG215-UG250] 

Neuralprobe  instruments  are  available  which  provide 
the  ability  to  perform  internal  network  diagnostics  by 
allowing  specify  information  to  be  extracted  from  a  selected 
probe,  and  by  presenting  that  information  in  a  graphical  form 
for  weights,  error  values,  or  activation  levels. 
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As  mentioned  earlier,  the  capability  of  accessing  the 
data  internal  to  Neuralworks  or  presenting  information  to  the 
network,  is  made  possible  through  the  use  of  a  user  defined 
module,  USERIO.  This  method  of  access  incorporates  a  user 
written  procedure  (SimoMonika.c)  to  the  network,  as  shown  in 
Appendix  C. 

The  communication  between  Neuralworks  and  USERIO  is 
through  a  series  of  data  pointers  which  are  described  in  the 
introductory  pages  of  Appendix  A. 

Neuralworks  uses  user-defined  control  strategies  to 
supervise  the  input-output  sequencing,  the  learning,  and  how 
and  when  the  information  is  passed  through  the  layers  of  the 
network.  Neuralworks  provides  also  default  control  strategies 
for  standard  networks.  The  strategies  are  written  in  assembly 
like  language  and  are  automatically  loaded  into  memory  when 
the  networks  are  loaded.  The  two  control  strategies  used  in 
this  research  are  shown  in  Appendix  D.  Both  strategies  will 
be  described  in  more  detail  in  the  following  section. 

The  Matlab  program  with  its  signal  processing  and 
robust-control  tool  boxes  was  used  intensively  during  the 
research.  Written  in  C,  Matlab  provides  a  high-performance 
interactive  software  package  for  scientific  and  engineering 
computation  [Ref.  13].  Matlab  was  employed  mainly  to  perform 
time  and  Bode  frequency  response  analysis  by  comparing  the 
system  and  the  actual  neural  network  responses. 


In  summary,  the  SPARC  Station  2,  Neuralworks 
Professional  II/PLUS,  and  the  Pro-Matlab  programs  provided  the 
necessary  tools  to  successfully  investigate  the  neural  network 
adaptive  control  algorithm  applied  to  the  longitudinal 
dynamics  of  the  X-29. 

B.  MODEL  DESIGN  CONSIDERATION 
1.  Design  Objectives 

In  any  implementation  of  a  neural  network  adaptive 
controller,  the  design  objectives  of  the  system,  the 
controller  and  the  estimator,  must  be  made  clear. 

The  system  must  be  controllable  and  observable  in 
order  for  the  controller  and  the  estimator  to  be  realizable. 
The  Optimal  and  Limited  performance  cases  fulfill  both 
conditions. 

The  controller  has  to  be  able  to  track  some  sort  of 
model  reference  or  predicted  output.  Stability  is  also  an 
important  aspect  of  a  controller.  The  poles  of  the  transfer 
function  have  to  be  well  within  the  unit  circle  for  stability. 
Zeros  that  are  outside  the  unit  circle  are  non-minimum  phase 
zeros.  When  the  transfer  function  is  inverted,  these  non¬ 
minimum  phase  zeros  become  unstable  poles.  The  unstable 
inverse  transfer  function  requires  complex  control  devices  for 
exact  tracking  [Ref.  l:pp.  32-49].  The  neural  network  adaptive 
controller  handles  the  non-exact  tracking  by  determining  the 
control  gains  in  some  least  square  sense. 
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The  back-propagation  learning  rule  perforins  this  task  with  the 
connections'  weights. 

The  estimator  has  to  model  the  input-output 
relationships  of  the  system.  The  selection  of  proper  inputs  is 
a  complex  issue  involving  the  input  spectrum,  the  sampling 
time,  and  the  data  record  length. 

a.  Input  Spectrum 

All  modes  of  the  system  must  be  excited,  which  is 
known  as  the  concept  of  persistent  excitation  [Ref.  7:p.  72]. 
This  concept  can  be  best  achieved  by  a  proper  selection  of  the 
input  spectrum.  The  input  spectrum  must  be  selected  in  such  a 
way  that  the  output  signal  strength  exceeds  any  expected 
noise.  A  high  signal  to  noise  ratio  must  be  maintained  to 
conserve  most  of  the  information  content  of  the  input  signal. 

b.  Aliasing  and  Sampling  time 

Since  sampling  the  data  leads  to  information 
losses,  it  is  important  to  select  the  proper  sampling  time. 
The  information  loss  is  best  described  in  the  frequency 
domain,  where 

Wg  =  2/T  denotes  the  sampling  frequency  where 
T  is  the  sampling  interval,  and 

f 

Wff  =  Wg/2  denotes  the  Nyquist  frequency. 

The  part  of  the  signal  spectrum  that  corresponds 
to  frequencies  higher  than  Wj^  will  be  interpreted  as  a 
contribution  from  lower  frequencies.  This  superposition  is 
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known  as  ''aliasing" .  Thus,  the  lost  of  information  concerning 
frequencies  higher  than  the  Nyquist  frequency  is  due  to 
sampling.  The  best  antialiasing  filter  is  to  sample  fast 
enough  to  eliminate  the  high-frequency  noise  contributions. 

Nevertheless,  sampling  too  fast  may  cause  loss  of 
information  in  the  low  frequencies,  while  sampling  too  slow 
may  cause  loss  of  information  in  the  high  frequency  modes. 

Another  problem  of  sampling  too  fast  is  the  energy 
distribution  problem  in  the  higher  frequencies  which  receive 
more  excitation.  This  phenomenon  will  be  demonstrated  in 
Chapter  VII  with  different  plots  of  Bode  frequency  responses. 

Figure  2  5  shows  the  resulting  poles-zeros  plot  for 
the  selected  sampling  time  of  0.02  seconds.  Notice  that  the 
poles  and  zeros  are  well  distributed  between  z  =  0.0  and  z  = 
1.0,  which  is  adequate  for  this  investigation.  Various  trials 
were  conducted  with  different  sampling  times  but  no 
improvements  to  the  value  of  0.02  seconds  were  found. 
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Figure  25  Poles  and  Zeros  of  the  X-29  Closed-Loop  Plant 

c.  Data  Record  Length 

The  simulation  used  in  the  USERIO  program  could 
generate  data  indefinitely.  Modelling  errors  in  the  simulation 
like  aliasing,  the  presence  of  non-minimum  phase  zeros  and 
unstable  poles  propagate  at  a  rate  proportional  to  the  power 
of  the  absolute  value  of  the  system  zeros  [Ref.  5:p.  43].  To 
prevent  the  modelling  errors  from  growing  unboundedly,  the 
simulation  has  to  be  reset  every  so  many  cycles.  Resetting  the 
simulation  adds  noise  to  the  frequency  spectrum,  as  will  be 
demonstrated  in  the  next  chapter. 

For  linear,  stable  systems,  the  data  will  be 
generated  indefinitely  since  the  errors  will  not  grow 
unbounded.  For  linear,  unstable  systems,  the  data  record 
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length  will  be  determined  by  limiting  the  network  outputs  to 
specific  values.  Finally,  for  non-linear  systems  using  an 
activation  function  like  the  hyperbolic  tangent  function,  the 
network  output  values  will  be  limited  to  +  1. 

2 .  Model  Structure  Selection 

The  model  structure  is  based  on  the  neural  network 
adaptive  controller  in  which  the  estimation  and  control 
algorithms  are  represented.  Before  selecting  the  model,  the 
number  of  input  and  output  elements,  the  status  (linearity  or 
non-linearity) ,  and  the  order  of  the  system  have  to  be  known. 
This  will  determine  the  size  of  the  regression  vector  which 
defines  the  number  of  elements  in  each  layer.  Whenever 
simulating  a  nonlinear  model,  hidden  layers  are  utilized  with 
nonlinear  transfer  functions. 

The  closed-loop  system  representing  either  the  optimal 
or  the  limited-performance,  is  a  30th  order  linear  system  with 
two  inputs  and  two  outputs.  Hence,  the  selected  model 
structure  could  be  a  MIMO  (multiple  inputs  -  multiple  outputs) 
or  a  SIMO  (single  input  -  multiple  outputs)  if  only  one  input 
is  activated  at  one  time  when  testing  the  network.  The  chosen 
network  structure  does  not  have  any  hidden  layers  since  the 
system  is  linear.  The  network  should  possess  a  regression 
vector  of  90  elements  if  represented  by  a  SIMO  model 
structure,  or  120  elements  if  represented  by  a  MIMO  model 
structure  (30  for  each  input  and  30  for  each  output) . 
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Two  basic  neural  network  model  structures  were 
developed  for  this  research. 

a.  SIMO  Neural  Network  Model  Structure 

Both,  optimal  and  limited,  performances  could  be 
represented  with  SIMO  model  structures.  Figure  26  shows  the 
SIMO  neural  network  structure  used  for  the  30  states  closed 
loop  X-29  plant.  The  first  layer,  the  feedback  layer, 


SIMO  Model  Struclure 

a<t)  a(t) 


.3  ■■■  -30  a(t-l)  -30  a(M)  -  -30 


consists  of  89  elements.  The  first  29  elements  are  the  past 
input  values  del (t-2 ) ,  del (t-3) ,  . . .del (t-30) ,  where  the  delay 
is  indicated  in  parentheses.  The  remaining  60  elements 
represent  the  delayed  past  output  measurements,  30  for  a(t) 
and  30  for  q(t)  . 
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The  command  layer,  the  second  layer,  is  a 
replicate  of  the  first  layer  with  the  exception  of  the 
reference  input,  r(t-l) ,  which  is  needed  for  the  control  law. 

The  control  layer,  the  third  layer,  consists  of  a 
single  element,  del(t-l),  the  control  input.  The  connections 
between  the  control  input  and  the  command  layer  elements  are 
weighted  with  a  fixed  value  of  zero,  since  the  command  layer 
was  intentionally  included  in  the  network  only  to  represent 
the  regression  vector,  i.e.,  no  learning  is  taking  place.  For 
control  law  purposes,  only  the  connection  between  the 
reference  input,  r(t-l),  and  the  control  input,  del(t-l) ,  is 
weighted  with  a  fixed  value  of  one.  Therefore,  r(t-l)  equals 
del (t-1)  . 

The  last  layer  is  the  output  layer.  The  output 
layer  is  fully  connected  with  variable  weights  to  the  control 
and  the  feedback  layers. 

Notice  that  this  network  has  no  hidden  layers 
between  the  control  and  the  output  layers  since  all  inputs  are 
directly  connected  to  the  output  layer.  Nevertheless,  the 
single  element  in  the  third  layer  becomes  a  hidden  layer  in 
itself,  since  it  relays  the  outputs  of  layer  two  to  layer 
four . 

The  estimation  process  begins  when  the  activation 
value  of  each  output  element  is  compared  directly  to  its  model 
predicted  output,  and  the  current  error  is  back-propagated 
through  the  control  and  feedback  layers  by  adjusting  their  weights. 
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b.  MIMO  Neural  Network  Model  Structure 

Figure  27  shows  a  MIMO  model  structure  used  for 
the  30  state  closed  loop  plant  of  the  X-29.  This  time,  two 
reference  and  control  inputs  were  present,  r^it-l) ,  r2(t-l) , 
deli(t-l)  and  del^ft-lj.  As  with  the  SIMO  structure,  ri(t-l) 
and  r2(t-l)  equal  del^(t-l)  and  del2(t-l)  . 


MIMO  Model  Structure 

a(t)  q(t) 


Figure  27  MIMO  Neural  Network  Model  Structure 

As  expected,  the  size  of  the  regression  vector  has 
increased  from  90  elements  to  120,  since  the  second  input  past 
measurements  are  added  to  the  vector. 

3.  Choices  of  Configurations 

In  this  thesis,  three  configurations  are  proposed  for 
training  neural  networks  to  provide  the  appropriate  inputs  to 
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the  X-29  plant  in  which  desired  responses  are  obtained.  These 
three  configurations  are:  the  simulation  of  the  closed-loop 
plant,  the  identification  of  the  inverse  plant,  and  the 
simulations  of  the  existing  controllers  and  the  plant, 
a.  simulation  of  the  Closed-Loop  Plant 

In  this  first  configuration,  the  neural  network 
will  emulate  the  closed-loop  architecture  of  Fig.  28.  The 
inputs,  Tj  and  r^,  to  the  30  states  transfer  function  that 
comprises  the  controller  and  the  plant  in  series  and  a 
negative  feedback  loop  of  gain  one,  will  be  the  inputs  to  the 
neural  network.  The  outputs  of  the  30  states  transfer 
function,  a  and  g,  which  represent  the  true  system  outputs, 
will  be  the  desired  outputs  of  the  neural  network. 


Closed-Loop  Architecture 


Neurol  Network 
Level  1 


Figure  28  Closed-Loop  Architecture 
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Each  performance,  the  optimal  and  the  limited, 
will  be  emulated  using  one  MIMO  model  structure  as  shown  in 
Fig.  27. 

In  order  to  facilitate  the  integration  of  the 
configurations  to  the  USERIO  program,  specific  case  numbers 
are  associated  with  each  configuration.  That  way  all  three 
configurations  can  use  the  same  USERIO  program,  SimoMonika.c. 
Each  case  number  is  stated  in  a  header  file.  A  header  file 
defines  all  the  variables  utilized  in  the  USERIO  program:  the 
case  number,  the  sampling  time,  the  input  conditions,  the 
numerator  and  the  denominator  coefficients  of  the  transfer 
functions.  All  the  header  files,  or  transfer. h  files,  used  for 
this  research  are  shown  in  Appendix  C.  The  numerator  and 
denominator  coefficients  were  obtained  using  the  MATLAB  file 
of  Appendix  D. 

As  to  the  control  strategy,  the  first  prototype, 
contstrl.nnc,  described  in  Appendix  B  is  employed  when  only 
one  structure  or  network  is  needed  to  represent  the 
configuration.  The  second  control  strategy,  contstr2 .nnc,  is 
employed  when  two  networks  are  needed  to  represent  the 
configuration.  Therefore,  the  single  MIMO  network  needed  to 
simulate  the  closed-loop  plant  should  be  trained  using  the 
first  control  strategy,  contstrl.nnc. 

Both  control  strategies  use  the  back-propagation 
algorithm  with  the  generalized  delta  learning  rule  which 
reduces  the  error  between  the  actual  and  desired  outputs  of  a 
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processing  element  by  modifying  the  incoming  connection 
weights . 

The  table  in  Appendix  E  shows  the  case  number,  the 
model  structure,  the  control  strategies,  and  the  header  files 
associated  with  each  configuration.  Notice  that  this  first 
configuration  contains  two  cases.  Case  #1  emulates  the  optimal 
performance  model,  and  case  #2  emulates  the  limited 
performance  model.  Also  notice  that  the  model  structure  has 
been  divided  into  two  levels.  Level  1  and  2  represent  the 
first  and  the  second  network  to  be  trained.  Both  levels  are 
usually  connected  in  series  and  could  be  trained  either  one  at 
a  time  or  both  simultaneously  depending  on  the  configuration 
chosen.  In  this  configuration,  only  level  1  applies  since  only 
one  network  is  necessary  to  represent  each  of  the  two  cases. 

When  training  neural  networks,  the  stability  of 
the  system  being  emulated  is  an  important  factor  to  be 
considered.  Since  the  transfer  functions  of  the  optimal  and 
the  limited-performance  models  are  stable  and  linear,  there 
should  be  no  requirements  for  resetting  the  networks.  The 
error  should  not  grow  unbounded  during  the  learning  process, 
b.  The  Identification  of  the  Inverse  Plant 

Figure  29a  demonstrates  the  second  configuration 
where  an  adaptive  architecture  is  presented  to  identify  the 
inverse  of  a  plant  [Ref.  14]. 
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Inverse  Plant  Architecture 


Neural  Network 
Level  2 


The  single  input,  u,  to  the  plant  will  be  the 
input  to  the  network  emulating  the  plant,  and  the  outputs  to 
the  plant,  a  and  g,  which  represent  the  true  plant  outputs, 
will  be  the  desired  network  plant  outputs.  Then,  the  network 
plant  outputs  become  inputs  to  the  network  emulating  the 
inverse  plant,  and  the  input  to  the  plant,  u,  becomes  the 
desired  network  inverse  plant  output.  Once  the  plant  inverse 
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has  been  found,  it  can  be  used  for  control  purposes  as  shown 
in  Fig.  29b.  The  desired  plant  output,  y'~y,  is  fed  into  the 
inverse  plant,  and  the  resulting  output  is  used  as  input  to 
the  plant.  As  a  result,  the  plant  input  produces  the  desired 
plant  output. 

This  control  method  can  be  applied  to  the  control 
of  linear  and  non-linear  systems  [Ref.  14:p.  34].  The 
configuration  differs  from  the  closed-loop  architecture  of 
Fig.  28  in  that  the  input  to  the  inverse  plant  is  the  desired 
plant  output  instead  of  the  actual  output,  and  that  no 
feedback  to  the  controller  is  required. 

In  this  second  configuration,  three  cases  will  be 
investigated,  as  shown  in  Appendix  E.  The  first  case  examines 
the  large  order  transfer  function  of  the  30  states  closed-loop 
X-29  longitudinal  plant  whose  inverse  is  stable.  The  second 
case  will  examine  a  simpler  aircraft,  the  A-4D,  which  has  a 
much  smaller  order  transfer  function,  but  whose  inverse  is 
unstable.  The  inverse  longitudinal  plant  of  the  A-4D  aircraft 
is  unstable  due  to  the  fact  that  the  plant  has  a  non-minimum 
phase  zero  at  -3.65  whose  inverse  becomes  an  unstable  pole,  as 
shown  in  Fig.  30. 
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Zeros  -  o  Real  Poles  -  + 

Figure  30  Poles  and  Zeros  of  the  A-4D  Plant 


Finally,  the  third  case  examines  the  X-29  plant 
which  is  a  larger  order  system  than  the  A-4D  and  which  has  one 
unstable  pole  at  +1.05  and  three  non-minimum  phase  zeros 
located  at  -4.5,  +2.2  and  +9.5,  as  shown  in  Fig.  31.  As  a 
consequence  of  the  unstable  pole,  the  X-29  plant  is  unstable, 
and  as  a  consequence  of  the  three  non-minimum  phase  zeros,  the 
inverse  plant  is  also  unstable. 
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Tc  =  cpf  Input  1 


Zeros  -  o  Real  Poles  -  + 

Figure  31  Poles  and  Zeros  of  the  X-29  Plant 

In  all  three  cases,  the  model  structure  is 
composed  of  two  levels:  level  1  emulates  the  closed-loop  plant 
for  case  #3  or  the  plant  for  cases  #4  &  5,  and  level  2 
emulates  their  inverse.  The  two  levels  are  connected  in  series 
and  can  be  trained  simultaneously. 

Figure  32  shows  the  inverse  plant  neural  network 
structures  developed  for  this  investigation.  As  anticipated 
from  Fig.  29,  this  configuration  requires  one  SIMO  neural 
network  model  structure  to  emulate  the  plant  and  one  MISO 
neural  network  model  structure  to  emulate  the  inverse  plant. 
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Figure  32  Configuration  #2  :  Identification  of  the 

Inverse  Plant 
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The  input  of  the  plant,  u(t-l) ,  becomes  the  output 
of  the  inverse  plant,  and  the  output  of  the  plant,  a(t)  and 
q(t)  ,  becomes  the  input  of  the  inverse  plant.  These  two 
operations  are  performed  in  the  USERIO  program,  and  are 
demonstrated  in  the  introductory  pages  of  Appendix  A. 

Since  both  systems,  the  X-29  plant  and  its 
inverse,  are  unstable,  the  neural  networks  will  have  to  be 
reset  many  times  to  prevent  the  error  from  growing  unbounded 
during  learning. 

c.  The  Simulations  of  the  Existing  Controllers 
and  the  Plant 

Figure  33  shows  the  third  configuration 
architecture.  The  inputs  to  the  controller,  and  d2,  which 
are  the  error  between  the  reference  inputs  and  the  plant 


Open-Loop  Architecture 


NofworV  Neural  Nelwoik 

Level  1  Level  2 


Figure  33  Open-Loop  Architecture 
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outputs,  will  be  the  inputs  to  the  network  emulating  the 
controller.  The  outputs  of  the  controller,  and  will  be 
the  desired  network  controller  outputs  and  the  inputs  to  the 
network  emulating  the  plant.  The  true  plant  outputs,  a  and  g, 
become  the  desired  network  plant  outputs. 

In  Fig.  28  the  entire  closed-loop  architecture  is 
emulated,  whereas  in  this  configuration  each  controller  and 
plant  is  simulated  separately  as  an  open-loop  architecture. 
Each  performance,  the  optimal  and  the  limited,  has  its  own 
controller  but  the  same  plant. 

As  shown  in  Appendix  E,  the  configuration  has 
three  cases.  Case  #6  &  #7  emulate  the  optimal  or  the  limited 
performance  controller  plus  the  plant,  and  case  #8  makes  the 
closure  of  the  open-loop  system  of  each  case.  The  closure 
implies  the  connection  in  series  of  the  controller  and  the 
plant,  and  the  insertion  of  a  negative  feedback  loop  of  gain 
one  from  the  plant  outputs  to  the  controller  inputs. 

Both  controllers  are  emulated  at  level  1  and  the 
plant  is  emulated  at  level  2,  using  MIMO  model  structures  as 
shown  in  Fig.  34.  In  all  three  cases  both  levels  can  be 
trained  simultaneously. 
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Configuration  #  3  :  Simulation  of  the  Existing 

Controllers  and  the  Plant 


delUt-2)  .’I  -14  d0l2(t-2)  ...  -14  a<t-1)  -  -14  q(M)  ...  -14 


X-29  Controller 

u1(t)  u2(t) 


del1(f-2)  .  ->6  del2(t-2)  ...  -16  oufl(M)  -16  out2(M)  •  -16 


Figure  34  Configuration  #3  ;  Simulation  of  the 
Existing  Controllers  and  the  Plant 


Referring  to  Fig.  34,  case  #8  is  represented  by 
having  the  controller  outputs,  ul(t)  and  u2(t),  becoming  the 
plant  inputs,  and  the  error  between  the  plant  outputs,  a(t) 
and  q(t)  ,  and  the  reference  inputs,  rl(t)  and  r2(t),  becoming 
the  controller  inputs,  dl(t-l)  and  d2(t-l).  These  operations 
are  performed  in  the  USERIO  program  and  are  demonstrated  in 
the  introductory  pages  of  Appendix  E. 

The  utility  of  this  third  configuration,  knowing 

that  effective  controllers  exist,  is  that: 

The  adaptive  network  may  be  able  to  form  an  effective 
control  rule  on  the  basis  of  representation  of  the  system 
state  that  is  easier  to  measure  than  the  representation 
required  by  the  existing  controller.  [Ref.  7:p,  30] 
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VI.  RESULTS  AMD  DISCUSSION 


The  experimental  results  of  the  eight  configurations' 
cases  described  in  Chapter  V  will  be  presented  in  this 
chapter.  Time  and  frequency  domain  analyses  of  the  neural 
network  structures  of  each  case  will  be  performed  to  determine 
how  close  they  are  to  the  true  system.  All  configurations 
except  case  #6  will  use  linear  networks.  Nonlinearity  will  be 
introduced  in  case  #6,  when  two  hidden  layers  are  added  with 
a  hyperbolic  tangent  transfer  function  to  the  network 
emulating  the  optimal  performance  controller. 

To  further  investigate  the  nonlinear  network  models,  an 
analysis  using  the  singular  value  decomposition  (SVD)  will  be 
carried  out  on  the  controller  network  of  case  #6.  The  optimal 
number  of  elements  per  hidden  layer  will  be  determined. 

A.  CONFIGURATION  #1:  SIMULATION  OF  THE  X-29  CLOSED- 

LOOP  PLANT 

1.  Case  #1  -  Optimal  Performance  X-29  Closed-Loop  Plant 

The  first  case  emulates  the  optimal  performance  X-29 
closed-loop  plant.  The  neural  network  is  trained  using  a 
single  MIMO  model  structure  fully  connected  with  a  linear 
activation  function.  Fully  connected  means  that  all  the 
elements  in  the  feedback  and  control  layer  are  connected  to 
all  the  elements  in  the  output  layer.  After  20,000  cycles  or 
300  seconds,  the  network  has  learned  to  respond  correctly  to 
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two  random  binary  inputs  of  magnitude  1.  The  random  binary 
swept  square  wave  is  an  input  signal  which  excites  all  the 
frequencies  of  interest. 

The  frequency  responses  of  the  linear  neural  network 
and  the  frequency  responses  of  the  optimal -performance  X-29 
model  to  two  random  binary  inputs  are  displayed  with  discrete 
Bode  plots  in  Fig.  3  5  through  Fig.  38.  The  frequency  responses 
of  a(t)  to  input  1  and  2,  which  are  shown  in  Fig.  35  and  37, 
develop  near  to  exact  model  solutions.  As  expected,  a  small 
amount  of  unmodelled  noise  dynamics  can  be  seen  around  the 
sampling  frequency  of  50  hertz.  In  Fig.  37,  the  network  does 
not  model  exactly  the  low  frequency  region  even  after  20,000 
epochs.  The  frequency  responses  of  q(t)  to  input  1  and  2, 
which  are  shown  in  Fig.  36  and  38,  are  very  similar  to  the 
ones  of  a(t) .  The  high  frequency  regions  of  both  inputs  and 
the  low  frequency  region  of  input  2  are  very  well  represented, 
whereas  the  low  frequency  region  of  input  1  shows  a  minor 
deviation  from  the  true  response,  as  shown  in  Fig.  36. 

To  show  how  close  the  network  outputs  are  to  the  true 
X-29  outputs,  the  RMS  prediction  error  plots  for  a  and  q  are 
given  in  Fig.  39  and  40.  Notice  that  the  vertical  scales  are 
on  the  order  10"^.  As  anticipated,  the  network  has  learned 
very  well  with  RMS  errors  on  the  order  of  0.00175  for  a  or 
0.175  percent  of  the  maximum  output  value  of  one,  and  on  the 
order  of  0.003  for  q.  Further  training  did  not  improve  the 
present  results. 
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The  performance  of  the  neural  network  in  the  time 
domain  was  determined  by  applying  a  step  of  one  degree  for  one 
second  to  each  input,  and  by  comparing  the  network's  outputs 
to  the  true  system,  as  shown  in  Fig.  41  through  Fig.  44.  As 
with  the  frequency  domain,  the  network  has  learned  to  model 
the  true  system  in  the  time  domain.  By  comparing  the  magnitude 
of  the  time  responses  of  Fig.  41  with  Fig.  42  ,  it  can  be  seen 
that  the  X-29  model  and  the  network  respond  to  input  1  with  a 
positive  a  while  the  q  response  is  negligible  (  order  of 
magnitude  is  10“^  )  .  In  Fig.  41,  the  network  responds  with  the 
same  a  rise  time  of  0.180  seconds,  and  with  the  same  magnitude 
of  about  1.08  degree  as  the  true  model.  In  Fig.  42,  the 
network  q  response  is  as  fast  with  a  rise  time  of 
approximately  .095  seconds.  The  small  oscillations  produced  by 
the  neural  network  q  response  in  Fig.  42  are  negligible  since 
the  magnitude  of  the  signal  is  very  low. 

By  comparing  the  magnitude  of  the  time  responses  of 
Fig.  4  3  with  Fig.  44,  it  can  be  seen  that  the  responses  of 
input  2  are  the  reversed  responses  of  input  1,  i.e.,  this 
time,  the  g  response  is  positive  while  the  a  response  is 
negligible  with  an  order  of  magnitude  10“^. 


71 


Altitude=  30,000  feet  frequency(h2)  Mach=  0.5 


error 


Prediction  error  for  alpha 


74 


^SEC 


TIME  -  SEC 


Figure  41  X-29  Model  and  Network  a  Time  Responses 
to  Input  1  (Optimal  case) 


Figure  42  X-29  Model  and  Network  q  Time  Responses 
to  Input  1  (Optimal  case) 
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Figure  43  X-29  Model  and  Network  a  Time  Responses 
to  Input  2  (Optimal  case) 
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Figure  44  X-29  Model  and  Network  q  Time  Responses 
to  Input  2  (Optimal  case) 
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2.  Case  #2  -  Limited  Performance  X-29  Closed-Loop  Plant 

This  second  case  emulates  the  limited  performance  X-29 
closed-loop  plant.  The  neural  network  is  trained  using  also  a 
single  MII.O  model  structure  fully  connected  with  a  linear 
activation  function.  The  network  has  learned  to  respond 
correctly  after  20,000  cycles  or  300  seconds  using  two  random 
binary  inputs  of  magnitude  1. 

The  frequency  responses  of  the  linear  neural  network 
and  the  frequency  responses  of  the  limited  performance  X-29 
model  to  two  random  binary  inputs  are  displayed  with  discrete 
Bode  plots  in  Fig.  4  5  through  Fig.  48-  The  frequency  responses 
of  aft)  and  gft)  to  input  1  and  2,  which  are  shown  in  Fig.  45 
through  48,  develop  near  to  exact  model  solutions.  As  with  the 
optimal  case  #1,  the  frequency  responses  of  aft)  to  input  l 
and  2  show  unmodelled  noise  dynamics  around  the  sampling 
frequency  of  50  hertz,  as  shown  in  Fig.  45  and  47.  Further 
training  did  not  improve  the  present  results.  Contrary  to  the 
optimal  case  #1,  the  network  is  better  able  to  model  the  low 
frequencies  of  both  inputs. 

RMS  prediction  error  plots  for  a  and  g  are  given  in 
Fig.  49  and  50.  Notice  that  the  vertical  scales  are  on  the 
order  10”^.  As  expected,  the  network  has  learned  very  well 
with  RMS  errors  on  the  order  of  0.001  for  a  or  0.1  percent  of 
the  maximum  output  value  of  one  and  on  the  order  of  0.002  for 

g* 
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The  network  has  also  learned  to  model  correctly  the 
limited  performance  X-29  closed-loop  plant  in  the  time  domain. 
The  X-29  model  and  the  network  time  responses  to  input  1  and 
2  are  given  in  Fig.  51  through  Fig.  54.  As  with  the  optimal 
performance  X-29  of  case  #1,  the  limited  performance  X-29 
model  and  the  network  responded  to  input  1  with  a  positive  a 
and  to  input  2  with  a  semi-positive  q,  as  shown  in  Fig.  51  and 
54.  However,  the  decoupling  of  a  and  g  is  not  as  pronounced  as 
in  the  optimal  performance  case,  i.e.,  this  time,  the  q(t) 
responses  in  Fig.  52  and  the  a(t)  responses  in  Fig.  53  are  not 
negligible. 

The  step  responses  of  input  2  with  an  a  rise  time  of 
0.8  second,  in  Fig.  53,  and  with  a  g  rise  time  of  0.5  second, 
in  Fig.  54,  indicate  that  the  limited  performance  X-29  model 
and  the  network  are  slower  to  react  than  the  optimal 
performance  case  #1.  In  the  optimal  case  #1,  the  rise  time  of 
a  to  input  2  was  0.180  second  and  the  rise  time  of  g  to  input 
2  was  0.095.  The  slower  reaction  times  of  the  limited 
performance  case  is  due  to  the  fact  that  the  control  surface 
deflections  and  the  control  rates  of  the  X-29  airplane  were 
reduced  to  conform  with  the  actuators  limitations  [Ref.  2]. 

In  summary,  the  first  configuration  could  simulate 
case  #1,  the  large  order  and  stable  optimal  performance  X-29 
closed-loop  plant,  and  case  #2,  the  large  order  and  stable 
limited  performance  X-29  closed-loop  plant,  with  high 
accuracy . 
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Altitude  =  30,000  feet  frequency(hz)  Mach=  0.5 


Figure  45  X-29  Model  and  Network  ot  Frequency  Responses 
to  Input  1  (Limited  case) 


Figure  46  X-29  Model  and  Network  q  Frequency  responses 
to  Input  1  (Limited  case) 
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Altitude  =  30,000  feet  frequency(hz)  Mach=  0.5 

Figure  47  X-29  Model  and  Network  a  Frequency  Responses 
to  Input  2  (Limited  case) 


Figure  48  X-29  Model  and  Network  q  Frequency  responses 
to  Input  2  (Limited  case) 
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Figure  49  RMS  Prediction  Errors  for  o 
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Figure  50  RMS  Prediction  Errors  for  q 
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Figure  53  X-29  Model  and  Network  a  Time  Responses 
to  Input  2  (Limited  case) 


Figure  54  X-29  Model  and  Network  q  Time  Responses 
to  Input  2  (Limited  case) 
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B.  CONFIGURATION  #2:  IDENTIFICATION  OF  THE  INVERSE  PLANT 

The  second  configuration  is  divided  into  three  cases.  Each 
case  contains  two  levels  of  model  structure  as  shown  in  the 
inverse  plant  architecture  of  Fig.  29  in  Chapter  V.  The  neural 
network  representation  of  the  inverse  plant  architecture  is 
illustrated  in  Fig.  32.  The  SIMO  neural  network  structure  of 
the  first  level  in  Fig.  32  simulates  the  transfer  function  or 
the  plant,  and  the  MISO  neural  network  structure  of  the  second 
level  in  Fig.  32  simulates  the  inverse  transfer  function  or 
the  inverse  plant.  Before  attempting  to  test  the  inverse  plant 
neural  network  structures  of  Fig.  32  with  unstable  systems 
like  the  A-4D  or  the  X-29  inverse  plant,  the  stable  inverse  30 
states  closed-loop  transfer  function  of  the  optimal 
performance  X-29  model  will  be  examined  first.  Then,  the 
testing  of  the  small  order,  unstable  inverse  plant  of  the  A-4D 
will  follow  and  finally  the  unstable  inverse  plant  of  the  X-29 
will  be  investigated. 

1.  Case  #  3  -  Inverse  Closed-Loop  Plant  of  the  Optimal 

Performance  X-29  Model 

Since  the  transfer  functions  for  a(t)  and  q(t)  do  not 
have  any  non-minimum  phase  zeros,  the  inverse  30  states 
closed-loop  transfer  functions  of  the  optimal-performance  case 
are  stable. 

The  two  networks'  structure  of  Fig.  32  have  learned  to 
model  the  inverse  transfer  function  within  450,000  epochs  or 
11,250  seconds.  The  SIMO  network  structure  of  Fig.  32 
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representing  the  30  states  closed-loop  transfer  function  and 
the  MISO  network  structure  of  Fig.  32  representing  the  inverse 
transfer  function  have  been  trained  simultaneously.  As  with 
the  first  configuration,  a  random  binary  swept  square  wave  of 
magnitude  1  was  also  the  input  signal  at  level  1. 

After  the  two  networks  of  Fig.  32  are  fully  trained, 
the  random  binary  step  outputs  of  the  inverse  transfer 
function  at  level  2  (output  2)  should  be  equal  to  the  random 
binary  step  input  of  the  transfer  function  at  level  1  (input 

1)  .  A  time  history,  based  on  the  number  of  epochs,  of  the 
comparison  between  the  input  of  the  30  states  closed-loop 
transfer  function  and  the  output  of  the  inverse  transfer 
function  to  a  random  binary  input  signal  is  shown  in  Fig.  55 
through  Fig.  62.  The  KMS  errors  between  the  two  signals, 
output  2  and  input  1,  are  also  included  in  the  list  of 
figures. 

As  indicated  in  Fig,  55,  after  2000  epochs  or  500 
seconds,  the  output  of  the  inverse  transfer  function  (output 

2)  is  poorly  correlated  with  the  input  of  the  transfer 
function  (input  1).  The  RMS  error  is  approximately  1.00  or  100 
percent  of  the  maximum  output  value  of  one,  as  shown  in  Fig. 
56.  After  150,000  epochs  or  3750  sec,  output  2  shows  some 
similarities  with  input  1,  as  indicated  in  Fig.  57.  The 
network  emulating  the  inverse  transfer  function  at  level  2 
learned  to  limit  its  output  to  values  ±1  and  to  follow  the 
random  binary  step  inputs  of  the  transfer  function  at  level  1 
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more  closely.  This  time  the  RMS  error,  shown  in  Fig.  58, 
decreased  from  1.0  to  0.35.  After  250,000  epochs  or  6250  sec, 
output  2  shows  even  better  similarities  with  input  1,  as 
demonstrated  in  Fig.  59.  Only  the  magnitude  of  the  steps  need 
to  be  worked  on.  In  this  third  trial,  the  RMS  error  in  Fig.  60 
is  on  the  order  of  0.175.  Finally  in  Fig.  61,  after  450,000 
epochs  or  11,250  sec,  the  output  of  the  inverse  transfer 
function  (output  2)  shows  a  near  to  exact  solution  to  the 
input  of  the  transfer  function  (input  1)  .  The  lowest  RMS  error 
obtained  is  on  the  order  of  .008  or  0.8  percent  of  the  maximum 
output  value  of  one,  as  shown  in  Fig.  62. 

The  discrete  Bode  plots  in  Fig.  63  and  64  give  the  a 
and  g  frequency  responses  to  input  1  of  the  true  optimal 
performance  X-29  closed-loop  transfer  function  and  of  network 
2,  which  emulates  the  inverse  transfer  function.  The  frequency 
responses  of  network  1,  emulating  the  transfer  function,  were 
given  in  the  optimal  performance  case  #1. 

As  explained  in  Appendix  D,  the  Bode  plots  are 
obtained  using  the  spectral  transfer  function.  The  spectral 
transfer  function  is  calculated  using  an  output  vector  and  an 
input  vector.  When  dealing  with  the  neural  network  transfer 
function  of  level  1  in  Fig.  32,  the  input  vector  is  composed 
of  the  random  binary  step  input  signals  at  input  1  and  the 
output  vector  is  composed  of  the  a  and  g  time  responses  at 
output  1.  However,  when  dealing  with  the  neural  network 
inverse  transfer  function  of  level  2  in  Fig.  32,  the  input 


86 


vector  is  composed  of  the  random  binary  step  responses  at 
output  2  and  the  output  vector  is  composed  of  the  a  and  q 
input  signals  at  input  2. 

The  frequency  responses  are  well  modelled  across  the 
spectrum  with  the  exception  of  a  minor  deviation  in  the  low 
frequency  region  of  the  network  2  q  response  in  Fig.  64. 

In  both  time  and  frequency  domain  the  SIMO  and  MIMO 
neural  network  structures  of  Fig.  32  have  learned  to  model  the 
inverse  transfer  function  of  a  large  order,  stable  system. 
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Figure  56  RMS  Prediction  Error  after  2000  Epochs  (case  #3) 
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Network  450k  epochs 


Altitude  =  30000  feet  Frequency  (Hz)  Mach =.5 

Figure  63  X-29  Inverse  Plant  Model  and  Network  2  o 

Frequency  Responses  to  Input  1  (Optimal  case) 
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Figure  64  X-29  Inverse  Plant  Model  and  Network  2  q 

Frequency  Responses  to  Input  1  (Optimal  case) 


2.  Case  #  4  -  Inverse  Plant  of  the  A-4D  Aircraft 

The  fourth  case  analyses  an  open-loop  transfer 
function,  the  A-4D  fourth  order  plant,  instead  of  a  closed- 
loop  transfer  function,  the  X-29  30th  order  system  of  case  #3. 
As  mentioned  in  the  previous  chapter,  the  A-4D  plant  is  a 
small  order  system  whose  inverse  is  unstable  due  to  the  fact 
that  the  plant  has  a  non-minimum  phase  zero. 

In  this  configuration,  level  1  of  the  inverse  plant 
architecture  of  Fig.  29  represents  the  A-4D  plant  and  level  2 
represents  its  inverse.  In  Fig.  32,  the  same  SIMO  and  MISO 
neural  network  structures  of  the  X-29  case  #3  were  used  for 
this  case  with  the  exception  of  three  modifications.  The  first 
modification  is  that  there  are  four  outputs  to  the  A-4D  plant 
at  level  1  (u,a,g,  and  theta)  instead  of  two  for  the  X-29 
plant  (a  and  q)  ,  thus  there  are  four  inputs  to  level  2 
instead  of  two.  The  second  modification  is  that  the  network  of 
level  2  emulates  the  small  and  unstable  A-4D  inverse  plant 
instead  of  the  large  and  stable  X-29  inverse  plant.  Finally, 
the  third  modification  is  that  the  sampling  time  for  the  A-4D 
aircraft  is  0.1  seconds  instead  of  0.02  seconds  for  the  X-29 
aircraft.  The  sampling  time  being  0.1  seconds  indicates  that 
the  A-4D  longitudinal  modes  are  slower  than  the  X-29  dynamic 
modes . 

The  SIMO  and  the  MISO  networks  of  Fig.  32  have  learned 
to  model  the  A-4D  inverse  plant  after  25,000  cycles  or  450 
seconds.  The  random  binary  step  outputs  of  the  inverse  plant 
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network  2  (output  2)  shows  a  very  near  to  exact  solution  to 
the  random  binary  step  inputs  of  the  plant  network  1  (input 
1) ,  as  shown  in  Fig.  65.  The  lowest  RMS  error  obtained  is  on 
the  order  of  0.00015  or  0.015  percent  of  the  maximum  output 
value  of  one,  as  indicated  in  Fig.  66.  Notice  that  the 
vertical  scales  are  on  the  order  10“^. 

As  expected,  the  speed  of  the  simulation  was  much 
faster  for  the  A-4D  model  of  case  #4  than  for  the  X-29  model 
of  case  #3  since  the  order  of  the  system  is  seven  and  a  half 
times  smaller.  The  order  of  the  system  in  addition  to  the 
number  of  inputs  and  outputs  determines  the  number  of  elements 
in  the  regression  vector.  The  number  of  elements  in  the 
regression  vector  determines  the  number  of  connections  in  the 
neural  network  structure,  which  in  turn  determines  the  speed 
of  the  simulation.  The  smaller  the  order  of  the  system,  the 
smaller  the  number  of  connections  required  in  the  neural 
network,  and  therefore  the  faster  the  simulation. 

The  discrete  Bode  plots  of  Fig.  67  through  Fig.  70 
give  the  u,  a,  q,  and  theta  frequency  responses  of  the  A-4D 
plant  model  and  of  network  1,  which  emulates  the  plant.  The 
discrete  Bode  plots  of  Fig.  71  through  Fig.  74  give  the  u,  a, 
q  and  theta  frequency  responses  of  the  A-4D  inverse  plant 
model  and  of  network  2,  which  emulates  the  inverse  plant. 

As  with  the  X-29  model  case  #3,  the  spectral  transfer 
function  of  the  A-4D  inverse  plant  of  level  2  has  been 
calculated  using  the  random  binary  step  responses  of  output  2 
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as  the  input  vector  and  the  u,  a,  q  and  theta  input  signals  of 
input  2  as  the  output  vector.  Both  networks,  network  1 
simulating  the  A-4D  plant  and  network  2  simulating  the  A-4D 
inverse  plant,  as  shown  in  Fig.  67  through  Fig.  74,  have  no 
difficulties  to  model  the  high  frequency  region.  However,  even 
with  further  training,  the  networks  are  unable  to  better  model 
the  low  frequency  region.  The  same  results  were  obtained,  in 
respect  to  the  plant,  by  R.  Scott  [Ref.  1]. 

Knowing  that  the  time  responses  of  a(t)  and  q(t)  are 
predominantly  of  high  frequency  or  short  period  mode,  it  can 
be  seen  looking  from  the  Bode  plots  that  the  emulations  of  the 
A-4D  plant  and  its  inverse  have  been  accomplished  with  high 
accuracy. 
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RB  Input  comparison  after  25000  epochs 
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Figure  69  A*-4D  Plant  Model  and  Network  1  q  Frequency 
Responses 
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Figure  70  A-4D  Plant  Model  and  Network  1  theta  Frequency 
Responses 
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Figure  71  A-4D  Inverse  Plant  Model  and  Network  2 
Frequency  Responses 
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Figure  72  A-4D  Inverse  Plant  Model  and  Network  2 
Frequency  Responses 


Magnitude 


3.  Case  #  5  -  Inverse  Plant  of  the  x>29  Aircraft 

The  fifth  case  also  analyses  an  open-loop  transfer 
function,  the  X-29  fourteen  order  plant.  As  shown  in  Fig.  30 
and  31  of  Chapter  V,  the  A-4D  plant  has  no  unstable  pole  and 
one  non-minimum  phase  zero  at  -3.65,  whereas  the  X-29  plant 
has  one  unstable  pole  at  +1.05  and  three  non-minimum  phase 
zeros  located  at  -4.5,  +2.2,  and  +9.5.  As  a  consequence  of  the 
unstable  pole,  the  X-29  plant  is  unstable.  As  a  consequence  of 
the  size  of  the  X-29  non-minimum  phase  zeros,  +9.5  and  -4.5, 
versus  the  A-4D  non-minimum  phase  zero,  -3.65,  the  degree  of 
instability  of  the  X-29  inverse  plant  is  much  higher  than  the 
degree  of  instability  of  the  A-4D  inverse  plant. 

In  the  inverse  plant  architecture  of  Fig.  29,  the  X-29 
plant  without  controller,  which  has  not  been  modelled  prior  to 
this  case,  is  emulated  with  neural  network  1.  The  X-29  inverse 
plant  is  emulated  with  neural  network  2.  As  shown  in  Fig.  29, 
only  one  input  to  the  plant  is  necessary  to  investigate  this 
case  study.  Both  inputs  to  the  plant  will  be  analyzed  in  the 
third  configuration  when  simulating  the  controllers  and  the 
plant.  The  same  SIMO  and  MISO  neural  network  structures  of  the 
X-29  model  of  case  #3  are  used  in  addition  to  the  same  number 
of  outputs,  2,  and  the  same  sampling  time,  0.02  seconds.  The 
only  exceptions  are  that  the  neural  network  of  level  1 
emulates  a  smaller,  unstable  system  (X-29  plant)  and  that  the 
neural  network  of  level  2  emulates  a  very  unstable  system  (X- 
29  inverse  plant) . 
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After  25,000  epochs  or  300  seconds,  neural  network  1 
has  learned  to  model  the  unstable  X-29  plant  in  the  time 
domain.  The  a  and  q  time  responses  of  the  X-29  plant  model  and 
of  the  network  1  to  a  step  of  0.01  degree  for  one  second 
applied  to  input  l  are  given  in  fig.  75  and  76.  The  RMS  errors 
are  on  the  order  of  0.0005  for  a  or  5.0  percent  of  the  maximum 
output  value  of  one,  and  on  the  order  of  0.0001  for  q.  Notice 
in  both  figures  the  positive  exponential  departures  of  both 
responses  with  respect  to  time.  This  explains  why  a  step  input 
of  0.01  degree  was  chosen  over  the  step  input  of  one  degree  to 
test  the  system.  These  exponential  responses  can  be  controlled 
by  limiting  the  plant  outputs  to  a  certain  value.  Limiting  the 
plant  outputs  has  two  purposes.  First,  it  avoids  the  plant 
output  signals  to  grow  exponentially.  Second,  since  the  plant 
outputs  become  the  inverse  plant  inputs,  it  limits  the  control 
inputs  of  the  inverse  plant  network  2.  In  this  way  the  effects 
of  the  unstable  inverse  plant  are  restrained. 

In  case  #5  of  the  USERIO  program  of  Appendix  A,  the 
generation  of  the  system  or  plant  outputs  are  limited  to 
values  between  +  1.  Every  time  one  of  the  two  plant  outputs 
reaches  ±1,  the  same  output  is  reset  to  zero.  These  resets 
occur  approximately  every  90  epochs  or  1.8  seconds,  which 
introduces  noise  every  0.5  hertz  in  the  frequency  spectrum,  as 
demonstrated  in  Fig.  77  and  78.  The  mean  of  the  noise  dynamics 
in  Fig.  78  follows  the  true  plant  response  to  a  certain  point, 
around  20  hertz.  By  applying  an  adequate  filter,  a  proper 
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frequency  response  of  the  network  could  be  more  or  less 
obtained . 

The  very  unstable  inverse  plant  makes  the  task  of  the 
inverse  plant  network  2  more  difficult.  Even  after  500,000 
epochs  or  8,500  seconds,  neural  network  2  cannot  emulate  the 
inverse  plant,  as  shown  in  Fig.  79.  The  RMS  error  is  on  the 
order  of  0.6  or  60  percent  of  the  maximum  output  of  one. 

In  summary,  the  second  configuration  could  simulate 
case  #3,  the  large  order  and  stable  optimal  performance  X-29 
inverse  closed-loop  transfer  function  and  case  #4,  the  small 
order,  unstable  A-4D  inverse  plant,  but  it  could  not  simulate 
case  #5,  the  more  unstable  X-29  inverse  plant.  The  unstable  X- 
29  plant  was  however  emulated. 
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Figure  75  X-29  Plant  Model  and  Network  1  a  Time  Responses  to 
Input  1 


Figure  76  x-29  Plant  Model  and  Network  1  q  Time  Responses 
Input  1 
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Figure  77  X-29  Plant  Model  and  Network  1  a  Frequency 
Responses  to  Input  1 
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Figure  78  X-29  Plant  Model  and  Network  1  q  Frequency 
Responses  to  Input  1 
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Figure  79  RB  Inputs  Comparison  after  500K  Epochs  (case  #5) 

B.  CONFIGURATION  #3:  SIMULATIONS  OF  THE  X-29  EXISTING 
CONTROLLERS  AND  THE  X-29  PLANT 

In  the  simulation  of  the  optimal  X-29  closed-loop  plant  of 
case  #1  and  in  the  simulation  of  the  limited  X-29  closed-loop 
plant  of  case  #2,  the  entire  closed-loop  architecture  of  Fig. 
28  is  emulated,  whereas  in  case  #6  and  #7  each  controller  and 
plant  is  simulated  separately  as  the  open-loop  architecture  of 
Fig.  33.  After  both  the  controller  and  the  plant  are  emulated, 
case  #8  will  close  the  open-loop  model  of  both  cases  by 
connecting  in  series  the  neural  network  representing  the 
controller  and  the  neural  network  representing  the  plant,  and 
by  feeding  back  the  errors  of  the  plant  network  outputs  to  the 
controller  network  inputs,  as  illustrated  in  Fig.  33.  In  the 
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open-loop  architecture  of  Fig.  33,  level  1  emulates  the  X-29 
controller  and  level  2  emulates  the  X-29  plant.  The  neural 
network  representation  of  Fig.  33  is  shown  in  Fig.  34.  The 
first  MIMO  neural  network  structure  of  Fig.  34  simulates  the 
controller  and  the  second  MIMO  neural  network  structure  of 
Fig.  34  simulates  the  plant.  The  optimal  controller  case  #6 
introduces  a  nonlinear  network  model,  whereas  the  limited 
controller  case  #7  utilizes  a  linear  network  model.  In  this 
configuration,  only  the  time  domain  will  be  analyzed  since  the 
interests  are  on  the  time  responses  of  both  inputs  to  case  #8, 
as  described  above. 

1.  Case  #  6  -  Simulation  of  the  X-29  Optimal  Controller 

and  the  X-29  Plant 

This  case  emulates  the  stable  optimal,  controller  at 
level  1  and  the  plant  of  the  X-29  at  level  2.  This  controller 
is  stable  since  the  poles  and  zeros  of  the  transfer  functions 
of  the  two  inputs  are  within  the  unit  circle. 

The  optimal  controller  is  first  emulated  using  a 
linear  neural  network  i.e.  no  hidden  layers.  The  linear  neural 
network  1  has  not  learned  to  model  the  limited  controller  even 
after  200,000  epochs  or  4000  sec,  as  shown  in  Fig.  80  through 
Fig.  83.  The  network  has  difficulties  in  simulating  the 
magnitude  of  the  linear  ramps  of  the  responses  and  the 
magnitude  of  the  excursions.  The  best  example  is  shown  in  Fig. 
82.  The  network  could  learn  the  ascent  of  the  first  peak,  but 
it  could  not  make  the  descent  on  time.  The  difficulties  in 
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simulating  the  excursions  are  due  to  the  fact  that  their  rise 
times  are  approaching  the  sampling  time  of  0.02  seconds. 
Nevertheless,  in  all  four  graphs  the  time  responses  of  the 
controller  network,  network  1,  do  not  show  any  time  shifts. 

Since  the  optimal  controller  could  not  be  emulated 
using  a  linear  network  model,  nonlinearity  was  introduced  to 
see  if  a  nonlinear  network  model  could  bring  better  results. 
Therefore,  two  non-linear  networks  were  investigated  in  this 
case  study. 

The  first  nonlinear  network  involves  the  addition  of 
one  hidden  layer  between  the  control  input  layer  and  the 
output  layer  of  the  controller  MIMO  network  structure  of  Fig. 
34.  The  hyperbolic  tangent  function  is  used  as  the  transfer 
function  of  the  hidden  layer. 

Various  numbers  of  elements  in  the  hidden  layer  have 
been  tested.  The  best  results  were  obtained  within  25,000 
epochs  or  500  seconds  using  42  elements. 

The  time  responses  of  the  X-29  linear,  optimal 
controller  and  of  the  first  nonlinear  controller  network  to  a 
step  input  of  one  degree  for  one  second  are  shown  in  Fig.  84 
through  Fig.  87.  The  RMS  errors  are  on  the  order  of  0.0001  for 
output  1  or  0.01  percent  of  the  maximum  output  of  one,  and 
0.00005  for  output  2.  There  are  some  improvements  from  the 
linear  network  responses  (0  hidden  layer)  to  the  nonlinear 
network  responses  (1  hidden  layer).  Referring  to  the  above 
mentioned  figures,  all  the  linear  ramps  of  the  responses  are 
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well  modelled.  However,  the  peaks'  values  are  not  well 
represented,  as  shown  in  Fig.  86. 

The  second  nonlinear  network  involves  the  addition  of 
two  hidden  layers  between  the  control  input  layer  and  the 
output  layer  of  the  controller  MIMO  network  structure  of  Fig. 
34.  The  first  hidden  layer  from  the  bottom  has  the  same  number 
of  elements  as  the  one  of  the  previous  test,  i.e.,  42.  To 
determine  the  optimal  number  of  elements  in  the  second  hidden 
layer,  a  SVD  analysis  was  carried  out  based  on  the  weight 
connections  of  the  two  hidden  layers. 

The  SVD  was  calculated  for  different  numbers  of 
elements  (30,  21,  12  and  5)  or  trials  using  the  weight 
matrices,  which  are  composed  of  the  connections  weights  of  the 
two  layers.  The  results  are  given  in  Fig.  88  through  91.  In 
all  four  trials,  the  networks  have  been  trained  using  the  same 
learning  rate.  In  all  SVD  plots,  three  lines  stand  out, 
meaning  that  the  optimal  number  of  elements  in  the  second 
hidden  layer  should  be  three.  After  some  oscillations  between 
0  and  1500  epochs,  the  network  in  all  four  trials  (30,  21,  12, 
and  5  elements)  stabilizes  to  constant  values.  For  example,  in 
Fig.  88  the  network  comprising  a  second  hidden  layer  of  30 
elements  stabilizes  around  SVD  5,  3.5,  and  0.5. 

Therefore,  forty-two  elements  in  the  first  hidden 
layer  and  three  elements  in  the  second  hidden  layer  should  be 
sufficient  to  represent  the  second  nonlinear  network  model  (2 
hidden  layers) . 
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The  time  responses  of  the  X-29  linear,  optimal 
controller  and  the  second  nonlinear  network  1  to  a  step  input 
of  one  degree  for  one  second  are  shown  in  Fig.  92  through  Fig. 
95.  The  RMS  errors  are  on  the  order  of  0.001  for  output  1  and 
0.0004  for  output  2.  The  responses  are  very  similar  to  the 
first  nonlinear  network  l  (l  hidden  layer) .  Comparing  Fig.  92 
with  Fig.  84,  Fig.  93  with  Fig.  85,  and  Fig.  95  with  Fig.  87, 
the  linear  ramps  of  the  two  nonlinear  networks  are  well 
modelled  but  the  peaks  are  not  well  represented.  Comparing 
Fig.  94  with  Fig.  86,  both  networks  responded  with  high  peak 
values  which  are  not  present  in  the  true  optimal  controller 
responses.  As  with  the  first  nonlinear  network  (1  hidden 
layer) ,  no  time  shifts  are  found. 

The  second  part  of  case  #6  involves  the  simulation  of 
the  X-29  unstable  plant  at  level  2,  as  shown  in  Fig.  33.  In 
the  X-29  plant  of  case  #5  only  one  input  to  the  plant  was 
necessary  to  investigate  the  case,  whereas  in  case  #6,  case  #7 
and  case  #8  both  inputs  to  the  plant  are  necessary.  After 
40,000  epochs  or  800  seconds,  network  2  has  learned  to  model 
the  unstable  X-29  plant  using  a  MIMO  network  structure  rather 
than  a  SIMO  structure  as  in  the  X-29  plant  case  #5.  It  took  as 
long  to  train  the  SIMO  network  structure  as  to  train  the  MIMO 
structure.  The  q  and  a  time  responses  of  the  X-29  plant  model 
and  of  neural  network  2,  which  emulates  the  plant,  to  a  step 
of  0.01  degree  for  one  second  applied  to  input  2  are  given  in 
Fig.  96  and  97.  The  responses  to  input  1  were  given  in  the  X- 
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29  plant  model  of  case  #5.  Once  again,  both  responses  have  an 
exponential  departure  with  respect  to  time.  This  time,  the 
departures  are  in  the  opposite  direction.  As  with  case  #5,  the 
plant  outputs  were  limited  to  values  +  1  to  control  the 
negative  exponential  responses. 
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I  82  X-29  Optimal  Controller  Model  and  Network  1  a  Time 
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Figure  83  X-29  Optimal  Controller  Model  and  Network  1  q  Time 
Responses  to  Input  2  (  0  Hidden  layer  ) 
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Figure  85  X-29  Optimal  Controller  Model  and  Network  l  q  Time 
Responses  to  Input  1  (  l  Hidden  layer  ) 
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Figure  86  X-29  Optimal  Controller  Model  and  Network 
Responses  to  Input  2  (  i  Hidden  layer  ) 
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Figure  87  x-29  Optimal  Controller  Model  and  Network 
Responses  to  Input  2  (  1  Hidden  layer  ) 
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Figure  88  SVD  Plot  of  the  Wgt  Matrix  (Hidden  2- 
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SVD  plot  of  the  wgt  matrix  (hidden  2-21  elements) 


Number  of  Epochs 

Figure  89  SVD  Plot  of  the  Wgt  Matrix  (Hidden  2- 
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Figure  90  SVD  Plot  of  the  Wgt  Matrix  (Hidden  2-  12  elements) 
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Figure  91  SVD  Plot  of  the  Wgt  Matrix  (Hidden  2-  5  elements) 


117 


Figure  92  X-29  Optimal  Controller  Model  and  Network  1  a  Time 
Responses  to  Input  1  (  2  Hidden  layer  ) 
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94  X-29  Optimal  Controller  Model  and  Network  1  a  Time 
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Figure  95  X-29  Optimal  Controller  Model  and  Network  1  q  Time 
Responses  to  Input  2(2  Hidden  layer  ) 
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Figure  96  X*-29  Plant  Model  and  Network  2  a  Time 
Responses  to  Input  2 


Figure  97  X-29  Plant  Model  and  Network  2  q  Time 
Responses  to  Input  2 
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2.  Case  P  1  ~  Simulation  of  the  X-29  Limited  controller 
and  the  X-29  Plant 

This  case  emulates  the  stable,  limited  controller  at 
level  1  and  the  plant  of  the  X-29  at  level  2,  as  shown  in  Fig. 
33.  The  controller  is  stable  because  the  poles  and  zeros  of 
the  two  inputs  are  within  the  unit  circle. 

Network  1  has  learned  to  model  the  limited  controller 
within  20,000  epochs  or  400  seconds,  as  shown  in  Fig.  98 
through  101.  The  RMS  errors  are  on  the  order  of  0.001  for  a 
and  on  the  order  of  0.0005  for  g.  Comparing  the  four  figures, 
the  a  and  g  time  responses  to  input  1  show  near  to  exact 
solutions,  whereas  the  a  and  g  time  responses  to  input  2  show 
minor  deviations  from  the  true  limited  controller  model. 
Further  training  did  not  better  the  results  of  input  2. 
Nonlinearity  was  also  introduced  to  network  l  emulating  the 
limited  controller  by  adding  hidden  layers  ,  but  no 
improvement  to  the  present  results  were  found. 

The  second  part  of  case  #7  involves  the  simulation  of 
the  X-29  unstable  plant  at  level  2,  as  shown  in  Fig.  33.  After 
40,000  epochs  or  800  seconds,  network  2  has  learned  to  model 
the  unstable  X-29  plant  using  the  same  MIMO  network  structure 
than  the  optimal  case  #6.  As  with  case  #6,  the  output  values 
of  the  plant  were  limited  to  +1  to  control  the  exponential 
departures  of  the  responses. 
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Figure  99  X-29  Limited  Controller  Model  and  Network  1  q  Time 
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Figure  101  X-29  Limited  Controller  Model  and  Network  1  q 
Time  Responses  to  Input  2 
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3.  Case  #8  -  Closure  of  the  Open-Loop  Model  of  the 

Optimal  Controller  of  Case  #6  and  of  the 

Limited  Controller  of  Case  #7 

After  both  the  controller  and  the  plant  of  case  #6  and 
#7  are  emulated,  case  #8  will  close  the  open-loop  model  of 
both  cases  by  connecting  in  series  the  neural  network 
representing  the  controller  and  the  neural  network 
representing  the  plant,  and  by  feeding  back  the  errors  of  the 
plant  network  outputs  to  the  controller  network  inputs,  as 
illustrated  in  Fig.  33. 

Case  #8  is  divided  in  two  parts.  The  first  part 
examines  the  closure  of  the  open-loop  model  of  the  optimal 
controller  of  case  #6,  and  the  second  part  examines  the 
closure  of  the  open-loop  model  of  the  limited  controller  of 
case  #7 .  These  operations  are  performed  in  case  #8  of  the 
U‘:i:pTO  program. 

In  the  first  part  of  case  #8,  since  the  X-29  optimal 
controller  could  not  be  modelled  exactly  by  the  linear  (0 
hidden  layer)  or  the  two  nonlinear  networks  (1  and  2  hidden 
layers)  of  case  #6,  no  solution  to  the  closure  of  the  open- 
loop  model,  case  #8,  was  obtained.  As  mentioned  previously, 
the  peak  values  could  not  be  well  represented  in  the  optimal 
controller  of  case  #6  since  the  excursions'  rise  times  were 
too  close  to  the  sampling  time  of  0.02  seconds. 

In  the  second  part  of  case  #8,  since  the  linear  neural 
network  1  of  case  #7  has  learned  to  model  the  limited 
controller  very  well,  a  solution  to  the  closure  of  the  open- 
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loop  model  was  obtained.  The  limited  performance  X-29  closed- 
loop  model  and  the  networks'  a  and  g  time  responses  to  input 
1  and  2  are  given  in  Fig.  102  through  105.  Referring  to  Fig. 
98  through  101  of  the  limited  performance  case  #7,  the  minor 
deviations  of  the  network  time  responses  from  the  true  model 
explain  the  small  time  shifts  occurring  in  the  closure  of  the 
open- loop  model  responses,  as  shown  in  Fig.  102  through  105. 

In  summary,  the  third  configuration  could  simulate 
case  #7,  the  X-29  limited  controller  and  the  X-29  unstable 
plant,  and  case  #8  part  II,  the  closure  of  the  open-loop  model 
of  case  #7,  with  high  accuracy.  However,  the  third 
configuration  could  not  simulate  the  optimal  controller  of 
case  #6  sufficiently  to  permit  case  #8  part  I,  the  closure  of 
the  open-loop  model  of  case  #6,  to  take  place. 
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Figure  102  X-29  Closed-Loop  Model  and  Networks  a  Time 
Responses  to  Input  1  (  Limited  case  ) 


Figure  103  X-29  Closed-Loop  Model  and  Networks  q  Time 
Responses  to  Input  1  (  Limited  case  ) 
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Figure  104  X-29  Closed-Loop  Model  and  Networks  a  Time 
Responses  to  Input  2  (  Limited  case  ) 


Figure  105  X-29  Closed-Loop  Model  and  Networks  q  Time 
Responses  to  Input  2  (  Limited  case  ) 
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VII.  CONCLUSIONS  AND  RECOMMENDATIONS 


The  neural  network  structures  developed  in  this  thesis 
demonstrate  the  ability  of  parallel  distributed  processing  in 
solving  adaptive  control  problems.  Adaptive  control  theory 
implied  a  combination  of  a  control  method  and  a  model 
estimation.  The  control  method  chosen  was  the  Lyapunov  Model 
Reference  Adaptive  Control  (MRAC)  in  which  the  system  was 
forced  to  follow  the  reference  model  with  zero  error.  The 
controller  itself,  the  weighted  one  step  ahead  prediction 
controller,  involved  the  weighted  sum  of  the  state  variables 
and  the  reference  input.  The  model  estimation  chosen  was  the 
linear  least  square  estimate  in  which  the  predicted  output 
became  the  weighted  sum  of  the  terms  in  the  regression  vector. 
These  weights  were  adjusted  by  minimizing  the  error  between 
the  network  and  the  true  X-29  responses.  The  implementation  of 
the  neural  network  adaptive  control  structure  was  demonstrated 
on  the  longitudinal  dynamics  of  the  X-29  fighter  aircraft. 

Three  configurations  were  proposed  to  train  the  neural 
network  adaptive  control  structures  to  provide  the  appropriate 
inputs  to  the  unstable  X-29  plant  so  that  desired  responses 
could  be  obtained.  These  configurations  were  presented  in 
eight  cases.  The  first  configuration  representing  the  closed- 
loop  architecture  of  Fig.  28  could  simulate,  with  a  linear 
network  model,  the  large  order  and  stable  optimal  and  limited 
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performance  X-29  closed-loop  plants  with  high  accuracy.  The 
networks'  time  and  frequency  responses  of  both  performance 
cases,  case  #1  and  case  #2,  developed  near  to  exact  model 
solutions . 

The  second  configuration  representing  the  inverse  plant 
architecture  of  Fig.  29  could  simulate  in  both  time  and 
frequency  domain  the  large  order  and  stable  optimal 
performance  X-29  inverse  closed-loop  transfer  function,  case 
#3,  and  the  small  order,  unstable  A-4D  inverse  plant,  case  #4. 
However,  the  second  configuration  could  not  simulate,  neither 
with  a  linear  nor  a  nonlinear  network  model,  the  more  unstable 
X-29  inverse  plant,  case  #5. 

Since  the  degree  of  instability  of  the  X-29  inverse  plant 
is  much  higher  than  the  degree  of  instability  of  the  A-4D 
inverse  plant,  the  simulation  of  the  inverse  plant  of  the  A-4D 
aircraft  could  be  achieved  easily  compared  to  the  X-29 
aircraft,  whose  inverse  plant  could  not  be  simulated. 

The  last  configuration  representing  the  open-loop 
architecture  of  Fig.  33  could,  with  a  linear  network  model, 
simulate  the  X-29  limited  controller  and  the  X-29  unstable 
plant,  case  #7,  with  high  precision.  In  the  optimal  controller 
of  case  #6,  the  nonlinear  neural  networks,  which  were  used  to 
model  the  linear  system,  performed  better  than  the  linear 
network  model. 

The  use  of  the  SVD  analysis  was  successful  in  determining 
the  optimal  number  of  elements  in  the  hidden  layers. 
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Further  studies  are  needed  to  develop  improved 
combinations  of  linear  and  nonlinear  neural  network 
structures.  In  addition,  it  is  important  to  pursue  research  on 
ways  of  reducing  the  computational  time  by  means  of  selecting 
the  proper  number  of  elements  in  the  hidden  layers  or  by  means 
of  selecting  the  proper  learning  rates. 
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APPENDIX  A:  NEURALWORKS  PROFESSIONAL  II  USERIO  PROGRAM 


^**«*********** 

*  Source: 

*  Executable: 

*  Version: 

*  Date: 

*  Author: 

*  Project: 

*  Environment: 

*  Path: 

*  Description: 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

*  case  (c#) 


***************************************************************** 

sinoMonika . c 

slnoMonika 

3.1 

30  August  1991 
D.  Bertrand 

Neural  Networks  in  Adaptive  Control 
UNIX/SunOS  C 

eileen:  /£il669/honie/Monika 

This  is  a  prototype  for  the  USERIO  program  spawned  by 
NWORKS  Professional  II  to  provide  input  and  output 
vectors  for  the  use  of  an  adaptive  control  neural  network. 

The  program  operates  by  running  a  simulation  of  the 
longitudinal  dynamics  of  the  X-29  and  A-4  aircrafts  at  the 
same  speed  as  sampling  time  of  the  network. 

The  program  can  be  used  for  any  SIMO  and  MIMO  linear  and 
non-linear  models. 

This  USERIO  program  has  been  divided  into  cases: 


<  Level  1  &  2  represent  two  networks  superimposed  > 


level  1 


level  2  control  strat. 


remarks 


* 

1,2 

X-29,  30  states 

— 

contstrl 

only  Level  l 

* 

closed-loop  conf. 

is  trained 

* 

* 

(optimal  &  limited) 

* 

3 

X-29,  30  states 

X-29  inverse 

contstrl 

to  train  Level  1 

* 

closed-loop  conf. 

closed-loop  conf 

. 

* 

* 

(optimal) 

contstr2 

to  train  Level  2 

* 

4 

A4  plant 

Inverse  Plant 

contstrl 

to 

train  Level  1 

* 

it 

contstr2 

to 

train  Level  2 

* 

5 

X-29  Plant 

Inverse  Plant 

contstrl 

to 

train  Level  1 

* 

A 

contstr2 

to 

train  Level  2 

6,7 

X-29  Controllers 

X-29  Plant 

contstr2 

to 

train  each  Level 

* 

* 

(Optimal  &  Limited) 

individually 

* 

8 

If  If  If  If  If  If  If  If 

If  If  fl  It  II 

II  IP  IP  II 

to 

test  case  6,7; 

* 

connect 

in  series  &  feedback 

case  3,4,5 


In  these  three  cases,  two  major  operations  are  performed  : 

-connecting  the  plant  and  the  inverse  plant  networks  in  series 
-presenting  the  desired  output  to  the  inverse  plant  network. 
These  operations  are  accomplished  in  the  case  request 
RQ_LEARNRSLT  When  Identifying  the  output  layer, 

if(IOCOUNT  ==  NUM_OUT  lOLAYER  -=  OUt_lay) { 

...  for  {i=0;  i<num_out;  i++)  { 

command2[i]=out[li;  ..meaning  that  alpha(t)  and  q(t) 

become  the  input  of  the  inverse 
plant . 


out2 [ 0 ]*command( 0] ; 


.meaning  that  r(t-l),  the  ref. input 
becomes  the  desired  output  of  the 
inverse  plant. 
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* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

★ 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 


case  6  &  7 

-  In  these  two  cases,  both  networks  are  trained  separately. 

The  connections  between  the  networks  will  be  done  in  case  #8. 


case  8 

- -  In  this  case,  two  major  operations  are  performed  on  case  #6  &  7: 

-connecting  the  controller  and  the  plant  networks  in  series, 
-feeding  back  to  the  controller  inputs  the  error  between  the 
network  plant  outputs  and  the  reference  inputs 
These  operations  are  accomplished  in  the  case  request 
RQ_LEARNRSLT  when  identifying  the  plant  and  the  controller  layers 

lf(IOCOUNT  =*  num_out  £&  IOLAYER==out_lay) { 

. . .  for  ( i=0 ;  i<nuTn_out;  i++)  { 

coiranand2  [  i]«out[i] ;  ..meaning  that  the  controller  outputs 

become  the  plant  inputs. 

> 

}... 

if(IOCOUNT  ==  nuin_out2  &&  I0LAYER==out2_lay )  { 

...for(i-0;  i<nuin_out2;  i++)  { 

cominand[  i ]=coinmand[  i]-out2  [  i) ;.  .meaning  that  the  controller 

inputs  become  the  error 
between  the  plant  outputs 
and  the  reference  in  puts. 

}  •  •  • 


Three  different  inputs  are  available: 

Input  1  -  Random  Binary 

Input  2  -  test  input  1  with  a  pulse  of  1  degree  for  1  sec 
Input  3  -  test  input  2  with  a  pulse  of  1  degree  for  1  sec 


/*  Include  the  following  external  modules  */ 


/include  <stdio.h> 

/include  <math.h> 

/include  "userutl.h” 

/*  /include  "transferSOhp.h" 

I*  /include  "transferlOlim. h" 
/*  /include  "transferhpl inv . h" 
/*  /include  "transferA4inv.h" 
/*  /include  ''transferl4inv.h" 
!*  /include  "transferl614hp.h" 
/include  "transferl614hp.h" 


File  of 
File  of 
File  of 
File  of 
File  of 
File  of 
/*  File  of 


parameters 

parameters 

parameters 

parameters 

parameters 

parameters 

parameters 


for  case  1 
for  case  2 
for  case  3 
for  case  4 
for  case  5 
for  case  6 
for  case  7 


(optimal)  */ 
(limited)  */ 
(X29)*/ 
(A4)*/ 
(X29)*/ 
(Optimal) */ 
(Limited) */ 


/*  Neuralworks  calls  the  USERIO  program  through  the  function  UsrIO  */ 

int  UsrIO 0 

{ 

/*  Declarations  */ 

extern  double  ts; 
extern  double  iterations; 
extern  double  pow(); 
extern  double  fmod(); 


/*  Sampling  time  */ 

/*  number  of  iterations  */ 
/*  Power  function  */ 

/*  Remainder  function  <*/ 


extern  long  random () ;  /*  Random  number  generator  */ 
extern  char  *input_name [ } ;  /*  Names  of  inputs  */ 

extern  double  numl[num_ini [num_out] (ordl] ;/*  Numerator  coefficients  */ 
extern  double  denlfordl];  /*  Denominator  coefficients  */ 
extern  double  num2[num  inZlfnum  out2 1 [ord2 ] ; /*  Numerator  coefficients  *! 


extern 

extern 

double  den2[ord2]; 
double  alphal; 

/* 

extern 

double  alpha2; 

/* 

extern 

double  alpha 3; 

/* 

static 

static 

int  profile={0}; 
int  redraw, in={0} ; 

/* 

static 

double  checkl; 

/* 

static 

double  check2; 

!* 

static 

double  count= {0.0}; 

/* 

static 

int  input; 

/* 

/*  Denominator  coefficients  */ 
Place  holder  for  Command[]*/ 

Place  holder  for  Commandf]*/ 

Place  holder  for  Command [] */ 


Redisplay  initialization  flag  */ 
Check  flag  */ 

Check  flag  */ 

Display  counter  */ 

Selected  input  */ 


static 

static 


double  rmem, rmeml , rmem2 ;  /*  Counters  for  inputs  */ 

double  r count, rcountl,rcount2;  /*  Counters  for  inputs  */ 
int  h,i,j,imax;  /*  Indices  */ 

char  buft90];  /*  Display  buffer  */ 

char  *sp;  /*  String  pointer  */ 


/*  Feedback  regression  vectors  */ 

static  double  feedback[num_feed]={0.0}; 
static  double  feedback2(num_feed2]={0.0} ; 

/*Ref  input  +  regression  vectors  */ 

static  double  command [num_comd]=  {0.0}; 

static  double  command2 [num_comd2]=  {0.0}; 

/*  Regression  vectors  applied  to  NN  */ 

static  double  control [num_cont]=  {0.0}; 

static  double  control2 (num_cont2]=  {0.0}; 

/*  Plant  responses  to  regression  vectors  */ 

static  double  out[num_out]  =  {0.0} ; 
static  double  out2 [num_out2]={0. 0} ; 


/*  Definitions  ♦/ 

#define  MAXRAND  (0x7ff ff ff f 1) 
/define  rand  random 

/*  Definitions  of  Level  i  */ 


/define  feedback_lay  0 
/define  command_lay  1 
/define  control_lay  2 

/*  /define  hiddenl_lay  3  For  non-linear  models  */ 
/*  /define  hidden2  lay  4  */ 

/define  out_lay  3 
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/*  Definitions  of  Level  2  */ 

/define  feedback2_lay  4 
/define  coinmand2_Tay  5 
/define  control2_lay  6 
/define  out2_lay  7 


I*  initialization  (if  necessary)  */ 
lORTNCDE  =  0; 


switch  (  lOREQCDE  )  { 


/* 


case  RQ_ATTENTION: 

/*  User  select  input  to  be  used  */ 

Again! : 

sprintf(  buf,"\nEnter  Desired  Input  Type  (1.  %s,  2.  %s,  3.  %s,  4.  %s" 
input_naine [  1  ] ,  input_name [2],  input_na!ne [  3 ) )  ; 

PutStr(  buf  )  ; 
sp==GetStr  ( )  ; 

sscanf (  sp,  "%ld",  Sinput) ; 
if  (  input  >3.  II  input<l.  )( 

sprintf(  buf,  " \n%s" ,  input_nanie  [  0}  ); 

PutStr(  buf  ); 
for(i=0;i<l000;i++)  { 

} 

goto  Again!; 

} 


/*  Display  selections  */ 

sprintf (  buf , "\nlnput:  %s  selected", 
input_nanie  (  input  ] )  ; 

PutStr(  buf  )  ; 
if(input==2.  II  input==3.){ 

PutStr ("\nEnsure  LR  is  set  to  zero  for  test"); 

} 

ln=l ; 
break ; 


case  RQ_REWIND: 

/*  Occurs  at  the  start  of  a  "learn  all". 

*  Rewind  any  input  files  to  the  beginning.  */ 

count=0. 0; 
break; 


case  RQ_LSTART: 

/*  Learn  start;  occurs  once  at  the  start  */ 


136 


/*  initialize  input  if  not  already  done  so  */ 


if (in==0) { 

input=l ; 
in=l  ; 


> 

/*  check  if  user  wishes  to  redisplay  after  every  plot  reaches  the  end  */ 

PutStr ("\nHow  often  do  you  wish  to  redraw  the  screen  (0  for  never)?"); 
sp=GetStr ( ) ; 

sscanf {  sp,  "%ld",  Sredraw) ; 


/*  start  random  binary  or  composite  in  time  sequence  */ 

if (num  in==l) { 
if (Tnput==l) { 

rcount=0 . 0 ; 

rmem=rand()  %  4; 

command toi=pow(-l.0,rmem) ; 

} 

} 

if (num  in==2 ) { 
if (Tnput==l) { 

rcountl=0 .0; 

rcount2=0. 0; 

rmeml=rand()  I  4; 

rmem2=rand ()  I  4; 

command (0]=pow(-i.0,rmeml) ; 

command [l]=pow(-l.0,rmem2) ; 

if(c==6  II  c==7){ 

command2[0]=pow(-1.0,rmeml) ; 
command? (I]=pow(-1.0,rmem2) ; 

} 

} 

) 


/*  start  test  with  a  pulse  of  1  degree  for  1  sec  */ 

if (num  in==l ) { 
if (Tnput==2 ) { 

rcount=50. 0; 
command [0]=alphal ; 

} 

} 

if (num_in==2) { 
if (input==2) { 

rcountl=50 . 0 ; 
rcount2=50. 0; 
command ( 0 ] =a Ipha 1 ; 
command [1)=0.0; 
if(c==6  II  c==7){ 

command? [0]=alpha3; 
command? ( 1)=0. 0; 

} 

} 
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if (input==3) { 


rcountl=50 . 0 ; 
rcount2=50. 0; 
command [l]=alphal; 
command [03=0.0; 
lf(c==6  II  c==7){ 

command2 [l]=alpha3; 
command2 [ 0 ] =0 . 0 ; 

} 

> 

} 


/*  display  the  starting  conditions  */ 

sprintf(  buf,  "\nCycles:  %f  Input:  %s", 
count ,  input_name [ input  J ) ; 

PutStr(  buf  ) ; 
break ; 


case  RQ_LEARHIN: 

/*  The  input  values  should  be  stored  in  lODATA  array  */ 


/*  input  feedback  layers  to  the  network  */ 

if(  IOLAYER==feedback_lay  &&  IOCOUNT==num_feed  ){ 
for(  i=0;  i<num  feed;i++  ){  ~ 

lODATA [1 ] =f eedback [ i ] ; 

) 

} 

if(  IOLAYER==feedback2_lay  &&  IOCOUNT==num_feed2  ){ 
for(  i=0;  i<num  feed2;i++  ){ 

lODATA [I ]=feedback2(i]; 

} 

} 

/*  input  commmand  layers  to  the  network  */ 

if (  IOLiAyER==command_lay  IOCOUNT==num_comd) { 
for(i=0;i<num_comd;i++) { 

lODATA [ i ] =command ( i ] ; 

} 

} 


if( 

} 


IOLAYER==command2_lay  &&  IOCOUNT==num_comd2) { 
for(i=0;i<num_comd2;i+4) { 

lODATA [ i 3  =command2 ( i ) ; 

> 


break ; 
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case  RQ_WRSTEP: 

/*  output  control  layer  from  network  */ 
break; 


/* 


case  RQ_LEARNOUT: 

/*  present  plant  or  model  responses  to  the  network  */ 

if(  IOLAYER==out_lay  &&  lOCOUNT==num_out) { 
for ( i=0 ; i<num_out ; i++) { 
IODATA[i]=out[i] ; 

} 

} 

if(  I0LAyER==0ut2_lay  &&  I0C0UNT==num_out2) { 
for (i=0;i<num_out2;i++)  { 
I0DATA[l]=out2[i] ; 

} 

} 

break; 


/* 


case  RQ_LEARNRSLT: 

/*  control  outputs  from  network  */ 

if(  IOLAyER“Control_lay  &&  IOCOUNT==num_in)  { 

if (num_in==l ) { 

for(i=o;i<num  cont;i++){ 

control  I i)=command[i] ; 

control [ 0 ] =IODATA[ 0] ; 

if (num_in==2) { 
imax=ordl ; 
if  (num_out==i) { 

imax=reg  veci; 

} 

for  (i=0; i<imax; i++) { 

^  control [ i ]=comroand[ i+num_out-l] ; 

for  (i=2;i<num_in+l;i++) { 
imax=ordl*i ; 
if  (num_out==i) { 

imax=reg  vecl; 

) 

if  (num_out>i-l) { 

for  (j=ordl*(i-i)+i;  j<in)ax;  j++)  { 

control (j ] “Command ( j+num_out-i] ; 

} 

} 

for  ( i=0 ; i<num_in; i++) { 

controltordl*i]=ioDATA[i J ; 
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/*  generate  system  and  model  response  to  this  control  input  */ 

for (i=0;i<num_out;i++) { 
out[i]=0.00; 

f or (h=0 ;h<num_in;h++) { 
for ( j=0; j<ordl; j++) { 

out [ i ] =out [ i ] +numl [h] { i ] [ j ) * (control [ ordl*h+ j ] ) ; 

} 

for ( j=0; j<ordl; j++) ( 

out ( i ]=out [ i ] +denl { j ]* (control [ordl* (i+num_in) +j ] ) 

} 


if (IOCOUNT==num_out  &&  IOLAYER==out_lay) { 

/*  shift  the  regression  vectors  */ 

if (num_in==l) { 

f or ( i=0 ; i<num_feed ; i++)  { 

feedback[i]=control[i] ; 

} 

for  ( i=0 ;  i<nuiti_f eed ;  i+4)  { 

command [ i  +  l ]=control  [  i ]  ; 

} 

} 

if (num_in>l) { 

for  (i=l;i<num_out+l;i++) { 
troax=ordl*i-i; 
if  (num  out==i){ 

Tmax=reg_vecl-1 ; 

) 

if  (num_out>i-l) { 

for  ( j=ordl*(i-l) ; j<imax; j++) { 

feedback[ j-(i-i) ]=control[ j] ; 
command (j+num_out-(i-l) ]=control[ j] ; 
} 

} 

} 

} 


/*  generate  a  new  random  binary  input  */ 

if (num_in==l) { 
if (input==l) { 

rcount++ ; 

command [ 0 ] =alphal ; 
if ( f mod (count, 2 . 0) <1 . 0) { 
rmem=rand()  %  4; 
command(0]=pow(-l.0,rmem) ; 
alphal=command[0] ; 
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* 


if  (nuin_in==2)  { 

if (input==l) { 

rcountl++ ; 
command [0]=alphal ; 
commandf 1 ]=alpha2 ; 
if (fmod(count,2.0)<1.0) { 
rmeml=rand()  I  4; 
rmem2=rand()  %4; 
command [0]=pow(-1.0,rmeml) ; 
command [l]=pow(-i.0,rmem2) ; 
alphal=command [0] ; 
alpha2=commandi 1]  ; 


} 


} 


} 


/*  generate  a  new  test  (pulse  of  1  degree  for  1  sec)  input  */ 

if (num_in==l) { 

if ( input==2 ) { 
rcount  — ; 
command [ 0 ] =a Iphal ; 
rmem=200 ; 
if  (rcount<=0. 0) { 
rmem — ; 

commandf  0]=0. 0; 
if (rmem<=0. 0) { 
roount=50.0; 
alphal=l .0; 


if (num_in==2 ) ( 
if ( input==2) ( 
rcountl 

commandf  0 ]=alphal ; 
command [ 1 ]=0. 0; 
rmeml=200 ; 
if ( r count 1<=0 . 0) { 
rmeml — ; 
command ( 0]=0. 0; 
if (rmeml<=0. 0) { 
rcountl=50. 0; 
alphal=l .0; 

} 

} 

} 

if ( input==3) { 
rcountl 

command ( 1 ]=alphal ; 
command [ 0 i=0 . 0 ; 
rmeml=200; 
if (rcountl<=0.0) { 
rmeml — ; 
command ( 1]=0.0; 
if (rmemi<=0.0) { 
rcountl=50. 0; 
alphal=l .0; 
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} 


} 


} 


} 


/*  load  the  regressors  with  system  and  model  responses  */ 


for(i=0;i<num_out;i++) { 

command (ordl* (i+num_in) ]=-out [ i ] ; 
feedback ( ordl* (i+num_in) -num_in]=-out[ i] ; 

} 


/*  load  the  input  of  Level  1  to  the  output  of  Level  2  */ 

if(c==3  II  c==4  II  c==5){ 

out2 [ 0 ] =command [ 0 ] ; 

> 

/*  load  the  outputs  of  Level  1  to  the  inputs  of  Level  2  */ 

if(c==3  II  c==4  II  c==5  II  c==8  II  ){ 
f or ( i=0 ; i<num_out ; i++) { 
command2 [ i )=out [ i ] ; 

} 

} 


/*  increment  the  counter  and  update  displays  as  necessary  */ 
count++; 

checkl=fmod(count, 1000. ) ; 
if (checkl<l . 0) { 

sprintf(  buf,  "\nCycles;  %f  Input:  %s", 
count , input_name [ input ] ) ; 

PutStr(  buf  ); 

if(c==5  II  c==6  II  c==7){ 
if (input==l ) { 

for ( i=0 ; i<num_out ; i++) { 

if (out [ i ]>l . 0  II  out[ i )<-l . 0) { 

for  (i=0; i<num_feed; i++) { 

feedback! i]=0. 0; 
command! i+num_in]=0. 0 

) 


} 


} 


) 


if (redraw  !“0){ 


} 


if (fmod (count , (double) redraw) <1 . 0) { 
IORTNCDE=l; 

} 
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ONLY  FOR  CASES  3  TO  8 


/* 


*/ 


if(  IOLAYER==control2_lay  &&  IOCOUNT==nu!n_in2  ){ 

imax=ord2 ; 
if  (nun>_in2==l)  { 

iinax=reg  vec2; 

} 

for  (i=0; i<imax;i++) { 

control2  [  i  ]=coinmand2  [  i+nuiti  in2-ll  ; 

} 

for  ( i=2 ; i<num_in2+l ; i++) { 
iinax=ord2*i ; 
if  (nuin_in2==i)  { 

iinax=reg  vec2; 

} 

if  (num_in2>i-i) { 

for  ( j=ord2*(i-l)+i;  j<iinax;  j++)  { 

control2  ( j  ]=command2  [  j+nuin_in2-i  ] ; 

) 

) 

for  (i=0;i<nuin  in2;i++){ 

control2(ord2*I]=IODATA[i] ; 

} 

/*  generate  system  and  model  response  to  this  control2  inputs  */ 

if(c==6  jl  c==7  II  c==8){ 

f or ( 1=0; i<num_out2 ; i++) { 
out2[i]=0.00; 
f  or  (h=0  ;h<nu7ti  in;h++)  { 
for ( j=0; j<ord2; j++) { 

out2 [ i ]=out2 ( i ]+num2 [h] ( i ] [ j ] * (control2 [ord2*h+j ) ) ; 

} 

for(j=0; j<ord2; j++) { 

out2 I i ] =out2 [ i ] +den2 ( j ] * (control2 [ord2* ( i+2 ) + j ] ) ; 

} 

) 

} 


if (IOCC>rNT==num_out2  &&  IOLAYER==out2_lay) { 

/*  shift  the  regression  vectors  */ 

for  {i=l ; i<num_out+l ; i++) { 
imax=ord2* i-1 ; 
if  (num  out==i)( 

Tmax=reg  vec2-l; 

) 

if  (num_out>i-l) { 

for  (j=ord2*(i-l)  ;  j<iinax;  j++)  { 

f eedback2 [ j- ( i-1 ) ] “control 2 [ j ] ; 
command2 [ j+num_out- ( i-1) ]=control2 [ j ) ; 
} 

) 

} 
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/*  generate  a  new  random  binary  input  */ 


if(c==6  II  c==7){ 
if (input==l)  { 

rcount2++ ; 
commands [ 0]=alphal ; 
commands [ 1 ]=alpha2 ; 
if ( fmod (count , 2 . 0) <1 . 0) { 
rmeml=rand()  %  4; 
rmem2=rand()  %  4; 
commands [ 0 ]=pow (-1 . 0, rmeml) 
commands ( 1 ]=pow(-l . 0, rmemS ) 
alphal=command2 [0] ; 
alpha2=command2 [ 1 ] ; 

} 


} 


} 


I*  generate  a  new  test  (pulse  of  1  degree  for  1  sec)  input  */ 

if(c==6  II  c==7){ 
if (input==2) { 
rcounts 

commands ( oi=alpha3 ; 
commands [ 1 j  =0 . 0 ; 
rmem2=200 ; 
if (rcount2<=0 . 0) { 
rmemS-- ; 

commands [ 0 )=0 . 0; 
if (rmem2<=0.0) { 
rcount2=50.0; 
alpha3=0.001; 

} 

} 

} 

if (input==3) { 
rcounts  — ; 
commands [ 1 ]=alpha3 ; 
commands ( 0 ] =0 . 0 ; 
rmem2=200; 
if (rcount2<=0. 0) { 
rmemS — ; 

commands [ 1 }=0. 0; 
if (rmem2<=0 . 0) { 
rcount2=50. 0; 
alpha3=0 . 001 ; 

) 

} 

) 

} 

/*  load  the  regressors  with  system  and  model  responses  */ 

if(c==3  II  c==4  II  c==5)( 

commands [ordl*num_out )=-out2 [ 0] ; 
feedbacks [ (ordi-i) *num_out]=-out2 [ 0] ; 


if(c==6  I  I  c==7  II  c==8)( 

for(i»0;i<num_out2;i++)  { 

commands [ ordS  * ( i+2 ) ] =-out2 [ i ] ; 
feedbacks [ ordS* ( i+2 ) -2 ] =-out2 ( i ] ; 

} 
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/*  calculate  the  error  value  going  into  the  controller  (feedback  loop)  */ 


if (c==8) { 

for  ( i=0 ;  i<nuin_out2  ;  i++)  { 

command ( i ] =command [ i ) -out2 [ i ] ; 

} 

} 


/*  increment  the  counter  and  update  displays  as  necessary  */ 

if(c==6  II  c==7){ 
if (input==l) { 

for { i=0 ; i<num_out2 ; i++)  ( 

if (out2[il>1.0  II  out2[i]<-1.0) { 

for  (i=0;i<num_feed2;i++) { 

f eedback2 [ i ) =0 . 0 ; 
command2 [ i+num_in]=0. 0; 

) 


} 


) 


} 


break ; 


/* 


case  RQ_LEND: 

/*  end  learning  mode,  display  current  status  */ 

sprintf(  buf,  "\nCycles;  %f  Input:  %s", 
count,  input_name[input] ) ; 
PutStr(  buf  ) ; 


break; 


case  RQ  RSTART: 


break ; 


case  RQ  READ; 


break; 


case  RQ_WRITE: 
break; 


145 


case  RQ_RCLTST: 
break; 


case  RQ_REND: 

/*  end  recall  ,  display  current  status  */ 

sprintf (  buf,  "\nCycles:  %f  Input:  %s", 
count ,  input_naine  [  input  ] )  ; 
PutStr (  buf  ) ; 


break; 

case  RQ_TERM; 

/*  terminate  userio  */ 

sprintf (  buf,  "\nCycles:  %f", 
count) ; 

PutStr (  buf  ); 

break ; 

} 

return; 
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APPENDIX  B:  NEURALWORKS  PROFESSIONAL  II  CONTROL  STRATEGIES  FILES 

csv2 . 1 

!file  format  is  Control  Strategy  Version  2.1 


! 


Source: 
Executable : 
Version: 

Date : 

Author : 
Co-Author 
Project : 
Environment: 
Path : 

Description: 


contstrl .nnc 

neuralworks  professional  II 
2 

30  Aug  1991 
D.  J.  Collins 
D.  J.  Bertrand 

Neural  Networks  in  Adaptive  Control 
UNIX/SunOS/Neuralworks  Control  Strategy 
eileen: / f il669/home/monika 

This  is  a  prototype  control  strategy  for  use  with 
the  simomonika  USERIO  program. 

This  strategy  uses  a  proprietary  language  which  is  covered 
in  some  detail  in  the  Neuralworks  Professional  II  manual. 

This  control  strategy  applies  only  for  cases  1,  2,  3,  4  &  5 
which  require  Level  1  to  be  trained  first. 

Each  network  must  use  the  back-propagation  learning  concept,  and 
possesses  at  least  an  input  or  feedback  layer,  a  control  or 
command  layer,  and  an  output  layer. 


Revisions:  Handles  all  hidden  layers 


!MASK  label 

op-code 

operands 

comment 

L  saRisa 

trace 

aux3 

1 

set 

trace  option  to 

aux3 

lI  aRisa 

1 

cset 

recall , 0 

1 

recall  count 

!  Get  inputs  for  Level 

1 

1  (learn  and 

recall) 

L  saRisa 

Iset 

in 

t 

set 

feedback  layer 

or  input 

L  saR 

io 

Irnin 

1 

get 

feedback  vector 

learn 

L _ Risa 

io 

read 

1 

get 

feedback  vector 

recall 

L_saRisa 

Iset 

cur,  1 

1 

set 

command  layer 

L  saR_^ _ 

io 

Irnin 

1 

get 

command  vector 

learn 

L  Risa 

1 

io 

read 

1 

get 

command  vector 

recall 

Start  forward  pass  to  but  not  including  output  layer 


L_saRisa 

Iset 

in 

L_saR_^ _ 

§loopl  math 

sum 

Inoise 

tran 

L _ Risa 

math 

sum 

rnoise 

tran 

L_saRisa 

Iset 

cur, 

,  1 

L  saRisa 

Icmp 

in,  +3 

L  saRisa 

bit 

?loopl 

Transfer  control  vector  to  userio  and 


1 

L  saRisa 

Iset 

in, +2 

L_saR^ _ 

io 

Irnrslt 

L _ Risa 

io 

write 

L  saRisa 

Iset 

in, +3 

L  saR^ _ 

io 

Irnout 

L  Risa 

io 

rcltst 

I 


!  set  feedback  layer  or  input 
output  I e=0 I  fire  !  fire  0th  layer  learn 
output le=0  !  fire  0th  layer  recall 
!  set  next  layer  learn  &  recall 
!  at  output  layer  ? 

!  loop  till  done 

get  desired  output 

!  set  control  layer  learn  and  recall 
1  sent  control  input  learn 

!  sent  control  input  recall 

!  set  output  layer  learn  and  recall 
!  get  output  layer  desired  learn 
!  get  output  layer  desired  recall 
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!  Compute  final  outputs  at  output  layer 

I 


L_saR^ _ 

L _ Risa 

L  Risa 


math 

math 

eos 


sum 

sum 


Inoise  ce=e  tran 
Inoise  ce=e  tran 


output 

output 


e-=w  f ire  I e*=ef I  swap] f ire 
e-=w  swap  ! recall 


I 


write  results  to  userio 


L_saR^ io  Irnrslt 

L _ Risa  io  write 


!  sent  output  learn 
!  sent  output  recall 


learn  cycle  back  propagate  error 


(note  at  output  layer) 


L_saR _  math 

L_saR _  §lloop  math 

L_saR _  Iset 

L_saR _  Icmp 

L_saR^ _  bgt 

L  aRisa  trace 


i=e|e=ce  !  put  desire  value  in  sum  field 

ce=e I e*=f ' ( backpl learn  I f ire  !  bkp/learn  3rd 
cur,-l  !  previous  layer 

in  !  at  input  layer? 

€lloop  !  loop  till  done 

0  !  turn  off  any  trace  function 


!  Note,  when  viewing  an  output  node,  output  contains  the  network  result, 
!  sum  contains  the  desired  result,  and  ce  contains  the  error. 
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csv2 . 1 

I  file  format  is 


Control  strategy  Version  2.1 


1  Source: 

!  Executable: 

!  Version: 

!  Date: 

!  Author: 

!  Project: 

!  Environment: 
!  Path: 

!  Description: 


contstr2 .nnc 

neuralworks  professional  ll 
2 

30  Aug  1991 
D.  J.  Bertrand 

Neural  Networks  in  Adaptive  Control 
UNIX/SunOS/Neuralworks  Control  Strategy 
eileen; /f il669/home/Monika 

This  is  a  prototype  control  strategy  for  use  with 
SimoMonika . c,  the  USERID  program. 

This  strategy  uses  a  proprietary  language  which  is  covered 
in  some  detail  in  the  Neuralworks  Professional  II  manual. 

This  program  is  a  continuity  to  contstral.nnc. 

For  cases  3,4  &  5  : 

After  Level  1  has  been  trained  with  contstral. 

Level  2  is  then  trained  with  this  control  strategy  using 
the  inputs  and  outputs  of  Level  1  as  references. 

For  cases  6  &  7  : 

Contstral  is  not  necessary,  since  both  Level  1  &  2  can 
be  emulated  simultaneously  with  contstra2. 

For  case  8  : 

No  training  takes  place.  Make  sure  LR  is  set 
to  zero  before  using  contstra2. 


IMASK  label 
L  saRisa 
lI  aRisa 


op-code  operands 
trace  aux3 
cset  recall, 0 


comment 

\  set  trace  option  to  aux3 
!  recall  count 


Get  inputs  of  Level  1  (learn  and  recall) 


_saRisa 

_saR _ 

_ Risa 

saRisa 

_saR^ _ 

Risa 


in 

Irnin 
read 
cur ,  1 
Irnin 
read 


set  feedback  layer  or  input 
get  feedback  vector  learn 
get  feedback  vector  recall 
set  command  layer 
get  command  vector  learn 
get  command  vector  recall 


Start  forward  pass  to  but  not  including  output  layer 

saRisa  Iset  in  !  set  feedback  layer  or  input 


LsaRisa 

Iset 

in 

L_saR^ _ 

§loopl  math 

sum  1 Inoise 

L _ Risa 

math 

sum  1 rnoise 

L_saRisa 

Iset 

cur,  1 

LsaRisa 

Icmp 

in, +3 

L_saRisa 

bit 

@loopl 

!  Transfer  control  vector  to  userii 
1 

L_saRisa 

Iset 

in,  +2 

L_saR^ _ 

io 

Irnrslt 

L _ Risa 

io 

write 

output  I e=0  !  fire  0th  layer  recall 

!  set  next  layer  learn  &  recall 
!  at  output  layer  ? 

!  loop  till  done 


!  set  control  layer  learn  and  recall 
!  sent  control  input  learn 

!  sent  control  input  recall 
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t'.ir'  f 


L_saRisa  Iset  in, +3  !  set  output  layer  learn  and  recall 

L  saR^ _  io  Irnout  !  get  output  layer  desired  learn 

L _ Risa  io  rcltst  !  get  output  layer  desired  recall 

Compute  final  outputs  at  output  layer 

saR_^ math  sum  I  Inoise  I  ce=e  I  tran  output  e-=w  I  f  ire  |  e*=ef  |  swap  |  f  ire 

_ Risa  math  sum | Inoise | ce=e | tran  output  e-=w|swap  irecall 

_ Risa  eos 

write  results  to  userio 


I 

!  write  results  to  userio 
! 

LsaR^ io  Irnrslt  ! 

_ Risa  io  write  • 


sent  output2  learn 
sent  output2  recall 


!  learn  cycle 
! 


back  propagate  error 


(note  at  output2  layer) 


L_saR 

math 

Ij  saR 

@loop4  math 

L^saR _ 

Iset 

L_saR _ 

Icmp 

L_saR^ _ 

bgt 

L~  aRisa 

trace 

i=e 1 e=ce 
ce=e I e*=f ' 
cur, -1 
in, +4 
@loop4 
0 


!  put  desire  value  in  sum  field 
|backp| learni fire  !  bkp/ learn  3rd 
!  previous  layer 
!  at  input2  layer? 

!  loop  till  done 

!  turn  off  any  trace  function 


output  contains  the  network  result, 
sum  contains  the  desired  result,  and  ce  contains  the  error. 
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APPENDIX  C:  NEURALWORKS  PROFESSIONAL  II  HEADER  FILES 


*  11  april  1991  * 

*  transfer30hp.txt  (Optimal  case  )  * 

*  Header  file  for  transfer  function  variables  * 

*  Sampling  time  0.02  sec  * 

*  CAPT  D.  Bertrand  * 


/*  Define  the  case  #  */ 

/define  c  1  /*  X-29,  30  states  closed-loop  conf.  */ 


/*  Define  the  variables  */ 


/*  Level  1  */ 

/define  ordl  30 
/define  nuin_in  2 
/define  reg_vecl  120 
/define  nuin_feed  118 
/define  num_comd  120 
/define  num_cont  120 
/define  num~out  2 


/*  order  of  the  X-29  closed-loop  conf.  */ 

/*  number  of  inputs  to  the  X-29  closed-loop  conf.*/ 
/*  regression  vector  =ord* (num_in+num_out)  */ 

/*  feedback  layer  =reg_vec-num_in  */ 

/*  command  layer  =  reg_vec  */ 

/*  control  layer  =  reg_vec  */ 

/*  output  layer  =  num_out  */ 


/*  Level 

/define 

/define 

/define 

/define 

/define 

/define 

/define 


2 

ord2 
num_in2 
reg~vec2 
num~feed2 
num~comd2 
num_cont2 
num  out2 


(  not  required  )  */ 

order  of  the  X-29  inverse  closed-loop  conf.*/ 
number  of  inputs  to  the  X-29  inverse  closed-loop*/ 
regression  vector  =ord* (num_in+num_out)  */ 
feedback2  layer  =  reg_vec-num_out  */ 
command2  layer=  reg_vec  */ 
control2  layer  =  reg  vec  */ 
output2  layer  =  num  In  */ 


/* 

/* 

/* 

/* 

/* 

/* 

/* 


/*  Declarations  */ 

static  double  ts={0.02}; 
static  double  alphal={ 1 . 0} ; 
static  double  alpha2={0 . 01 } ; 
static  double  alpha3  =  { 0 . 001 } ; 

static  char  *input_name[ ]={"Illegal  Input" , "Random  Binary", 

"A  Pulse  input  of  1  degree  for  1  sec  (input  1)"," (input  2)"}; 


static  char  *state_name[ ]={"Illegal  State" , "u (t) ", "alpha (t) " , 
"q(t)",  "theta (t)"); 


/*  Numerator  coefficients  of  the  X-29  closed-loop  conf.  */ 
/*  Order  is  al-a30  &  ql-q30  for  the  indices  */ 

static  double  numl [ 2 ] [ 2 ] [ 30 ] = 

{  7.217941790123916e-03, 

4. 136127382910360e-02, 

-4. 6697 689748593526-01, 
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1.7409153789107856+00, 
-3.8609720794906376+00, 
5.9100260018635146+00, 
-6.6036237249056176+00, 
5.4618151917355256+00, 
-3.2701589875142366+00, 
1.2766672995943946+00, 
-1.5207540746008876-01, 
-2 . 0511590497927666-01 , 
1.9453455561352856-01, 
-1 . 0560098407791206-01 , 
4 . 3050248168023056-02, 
-1.4215644251606826-02, 
3.8904658137292606-03, 
-8.7538785764993036-04, 
1.5675049676230896-04, 
-2.1084570150820936-05, 
1.9254190959238406-06, 
-9.2765395013213906-08, 
-7.8226921891163826-10, 
3.6066584558301456-10, 
-1.7312824376422586-11, 
2.8288302234390876-13, 
-1.0355132454054916-15, 
3.0846254753760786-17, 
6.0876291104632936-20, 
2.1887249680313356-33, 
3.0302790642480206-02, 
-2.1766173633113796-01, 
7.1994185223715596-01, 
-1.4458874688312456+00, 
1.9372324387532566+00, 
-1.7440105851398476+00, 
9.0461910307709566-01, 
7.5209838389071146-02, 
-6.9429194406558286-01, 
8.1801087288916116-01, 
-6.2963512311721816-01, 
3.7152343661376016-01, 
-1.7795723311457856-01, 
7,1131432158207286-02 , 
-2.4033782644765416-02, 
6.8791981660740466-03, 
-1.6561909025141496-03, 
3.3026441202249716-04, 
-5.3320550035187476-05, 
6.7644476175470786-06, 
-6.4961143581485486-07, 
4.5023811616075626-08, 
-2.0990336291178756-09, 
5.7059132705020976-11, 
-4.9361960941247396-13, 
-1.4631680352583936-14, 
3.3399213691611596-16, 
-1.6529692951845196-18, 
4.5114326681577396-20, 
1.6184970063670236-31 , 
2.9133038383459826-03, 
-1.8595871626274636-03, 
-7.2573197445194646-02, 


3.6559644135343216-01, 
-9.6063613295797276-01, 
1.6938273224886876+00, 
-2.1828393359645596+00, 
2.1285339757682786+00, 
-1.5872466494502366+00, 
8.9869460323163256-01 , 
-3.7308106254630506-01, 
9.9896949964975336-02, 
-4.9703266972640496-03, 
-1.1607626848188176-02 , 
7.7831522591773626-03, 
-3.2557528586436856-03, 
1.0454050542550936-03, 
-2.6834534250991426-04, 
5.4325483881243166-05, 
-8.2856961681480786-06, 
8.7787486193232486-07, 
-5.4989664083404366-08, 
1.0476354899686876-09, 
9.1244680246533386-11, 
-5.9756192760825506-12, 
1.0698710226035236-13, 
-3.5073759715930666-16, 
1.2114408936634036-17, 
2.0749706708994966-20, 
1.4964285142489216-33, 
4.9439060404695926-02, 
-2.4866598471972886-01 , 
4.6965274052844566-01, 
-1.7103848434612706-01, 
-1.0865346232516806+00, 
2.9362986289858676+00, 
-4.3559533529232236+00, 
4.5817409877602426+00, 
-3.7056624428255426+00, 
2.3999249408386026+00, 
-1.2769385384602576+00, 
5.681969684923196e-01, 
-2.1378955404650936-01, 
6,8243809851077146-02, 
-1.8366150266685426-02, 
4.0946990816251316-03, 
-7.3272999573451716-04 , 
9.9661535487493786-05, 
-9.1928700900608626-06, 
3.6389803556196636-07, 
3.8114038480433706-08, 
-8.1628146991403386-09, 
7.5143847871629916-10, 
-4.2019092702786086-11, 
1.4279360590625086-12, 
-2.689202646566666e-14, 
2.6459841745513366-16, 
-2.4992669474965216-18, 
1.6136839121627876-20, 
1.1059458799655776-31 
}; 


/*  Denominator  coefficients  */ 


static 

3 

-9 

1 

-2 

3 

-2 

2 

-1 

8 

-4 

1 

-6 

2 

-6 

1 

-3 

5 

-7 

8 

-7 

5 

-2 

8 

-2 

2 

-1 

2 

-5 

'8 


double  deni [30]= 

[  -8.7025733791802536+00, 

.  6241850549714346+01, 

.  63747  6611139380e+01, 
.8409445672474786+02, 
.6919328749661056+02, 

.  1334  25587  0225126+02, 
.9798535445379006+02, 
.3581629651227126+02 , 
.5745353225150886+02, 
.9675902025313426+01, 

.  3  9512464  8498  84  96  +  01, 

.  8662510649972566+01, 
.8944632993096026+00, 
.2180046442304386+00, 

.  194736024  6519416-01, 
.4909023924825766-01, 
.0558086631192036-02, 
.2505011205958746-03, 
.4179152688470946-04, 
.4269821612815006-05, 
.5092279267402486-06, 
.1054414682252226-07 , 

.  55900182093  05926-08, 

.  981854  29399137  06-10, 

.  0244228762992696-11, 
.5560687  5418  97846-13  , 
.8583910836869456-15, 
.0707848492584016-17, 
,2314690227766016-21, 
.2038285790876436-38 
}; 


/*  Does  not  apply 
static  double  num2 
static  double  den2 


for  the  case  1  * 
[1][1][1]=  {1.0} 
[1]={1.0}; 


/ 
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*  11  april  1991  * 

*  transfer301iio.txt  (Liinited  case  )  * 

*  Header  file  for  transfer  function  variables  * 

*  Sampling  time  0.02  sec  * 

*  CAPT  D.  Bertrand  * 


**************************************************************************** ^ 

/*  Define  the  case  #  */ 

#define  c  2  /*  X-29,  30  states  closed-loop  conf.  (limited  case)*/ 


/*  Define  the  variables  */ 


/*  Level  1  */ 

#define  ordl  30 
#def ine  num_in  2 
/define  reg_vecl  120 
/define  numfeed  118 
/define  num_comd  120 
/define  num_cont  120 
/define  num  out  2 


/*  order  of  the  x-29  closed-loop  conf.  */ 

/*  number  of  inputs  to  the  X-29  closed-loop  conf.*/ 
/*  regression  vector  =ord* (num_in+num_out)  */ 

/*  feedback  layer  =reg_vec-num_in  */ 

/*  command  layer  =  reg_vec  */ 

/*  control  layer  =  regvec  */ 

/*  output  layer  =  num_out  */ 


/*  Level  2  ( 

/define  ord2 
/define  num_in2 
/define  reg_vec2 
/define  num2feed2 
/define  num_comd2 
/define  num3cont2 
/define  num~out2 


not  required  )  */ 

1  /*  order  of  the  X-29  inverse  closed-loop  conf.*/ 

1  /*  number  of  inputs  to  the  X-29  inverse  closed-loop*/ 

1  /*  regression  vector  =ord* (num_in+num_out)  */ 

1  /*  feedback2  layer  =  reg_vec-num_out  */ 

1  /*  command2  layer=  reg_vec  */  "* 

1  /*  control2  layer  =  reg_vec  */ 

1  /*  output2  layer  =  num_in  */ 


/*  Declarations  */ 

static  double  ts={0.02}; 
static  double  alphal  =  { 1 . 0}  ; 
static  double  alpha2  =  {0.01} ; 
static  double  alpha3={ 0 . 001 ) ; 

static  char  *input_name( ]={"Illegal  Input” , "Random  Binary", 

"A  Pulse  input  of  1  degree  for  1  sec  (input  l)","( input  2)"}; 


static  char  *state_naroe[ ]={"Illegal  State" , "u (t) ", "alpha (t) " , 
"q(t)",  "theta (t)"); 


/*  Numerator  coefficients  of  the  X-29  closed-loop  conf.  */ 
/*  Order  is  al-a30  &  ql-q30  for  the  indices  */ 

static  double  numl[2] [2] [30]= 

{  2.8442201092104826-05, 

-4 . 63634 34904 60604e-05, 

-4. 816337  07 1247290e-04, 

2. 54 1965352 1794 32e-03, 
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-6.221344563186904e-03, 
9.700836906404220e-03, 
-1.056937401995128e-02, 
8.1280988270009406-03, 
-3.9790454973172026-03, 
4.5501472789055706-04, 
1.2332491028246306-03, 
-1.3844038270462996-03, 
9.0400248002708856-04 , 
-4.3247398398449386-04, 
1.6158719941472556-04, 
-4.8043167443445616-05, 
1.1228248251171646-05, 
-1.9437510868913776-06, 
2.0226294476094486-07, 
3.4089394952696586-09, 
-5.7040207848907756-09, 
1.0589824671331096-09, 
-9.7002693504981156-11, 
3.9549935509559556-12, 
1.5562579970371856-14 , 
-6.316655529366355e-15, 
1.4343419762277096-16, 
-5.2848110984161186-19, 
1.6946631323781006-20, 
2.2804314602647266-26, 
1.3028672542585446-03 , 
-7.3828514305063216-03, 
1.1332431325342906-02, 
2.624  4  36184  0667816-02  , 
-1.5987545788152606-01, 
3.8715270277725726-01, 
-6.1121694410030616-01, 
7.1029484917585256-01, 
-6.4201790012612046-01, 
4.6547734802243216-01, 
-2.7565852813893346-01 , 
1.3459004537006086-01, 
-5.4222950012274406-02, 
1.7832626196785386-02, 
-4.6316804024364446-03, 
8. 6170290163 689606- 04 , 
-6.9508538500517866-05, 
-2.2470158854204236-05, 
1.2 054 64 6996564896-05, 
-3.2185900773968126-06, 
5.9135390124639716-07, 
-7.8445774617314426-08, 
7.4218345116328136-09, 
-4.8157245609389006-10, 
2.0205942898012376-11, 
-5.0157987849741006-13, 
6.4389261580228756-15, 
-4 . 5954734912809406-17, 
5.5023381482226496-19, 
1.7144675889494886-24 , 
3.4147714005783316-05, 
-1.1149304280877466-04 , 
-1.8411342458080076-04, 
1.8546874595131166-03, 


-5.5860928713400436-03, 
1.0649624766983836-02, 
-1.4998628108060076-02, 
1.6489274295736326-02, 
-1.4361381592834736-02, 
9.8663968109349306-03, 
-5.2582033785029136-03 , 
2.0928212919670846-03, 
-5.5653611724437726-04 , 
4.8078255851180536-05, 
4.0662710127037376-05, 
-2.7194195530988456-05, 
1.0331563624399466-05, 
-2.9555816023485456-06, 
6.8705380061595546-07, 
-1.3169394151579816-07, 
2.0262214452723006-08, 
-2.3612338642231126-09, 
1.9210636005376766-10, 
-9.8099516113473946-12 , 
2.6532791038762796-13, 
-2.3192333728807826-15, 
-1.3171870618962196-17, 
-2.4070125358917116-19, 
-4.4338801182581846-21, 
2.7359035050224656-26, 
1.5969815429635056-03, 
-8.5283737037329396-03 , 
1.0861961067462296-02 , 
3.8468975642672386-02, 
-1.9767309355052026-01  , 
4.5543545357259066-01, 
-7.0045724103511026-01, 
8.0393733332584826-01, 
-7.2562729310539006-01, 
5,3026219241587576-01, 
-3.1891466144389826-01, 
1.5905139028632226-01, 
-6.5733010848674676-02, 
2.2259010121125306-02, 
-5.9889500294  207926-03  , 
1.1778424785156016-03, 
-1.1824465021814676-04, 
-2.0784566493736726-05, 
1.3692322386765776-05, 
-3.8019537697206456-06, 
7.0813343526975836-07, 
-9.4  37  638502624  414  6-08  , 
8.9367667595918246-09, 
-5.7947053770001466-10, 
2.4284642999365006-11, 
-6.0212343705601876-13, 
7.7244624741066246-15, 
-5,5166719524188556-17  , 
6.5959041913596866-19, 
2,0569005192821886-24 
}; 


/*  Denominator  coefficients  */ 


static  double  denl[30]= 

{  -1.135087146556161e+01, 

6.093263249866681e+01, 
-2.061911065822222e+02, 

4. 94803513273 1752e+02, 

-8. 9839237254834 06e+02, 
1.286089683000355e+03, 
-1.493744793706265e+03, 
1.4374213699047936+03 , 

-1. 164 29688962 083 4e+03 , 

8. 034 380606787 02 5e+02, 
-4.766521786713293e+02, 
2.4472389443295886+02, 
-1.0920864422028056+02, 

4 .2449161890226026+01, 

-1. 437006104677 V57e+01, 
4.225905264868553e+00, 
-1.0739317228196476+00, 
2.3388840658071476-01, 
-4.3131670434614746-02, 
6.6244551928140906-03 , 
-8.2866288849905656-04 , 
8.1950100277705596-05, 
-6.1603739420029166-06, 
3.3454169307707296-07, 
-1.2279216814863616-08, 
2.7754758018308796-10, 
-3.4102871701880146-12, 
2.5178955542159086-14, 

-2.74  2185292  5078  3.16-16, 
1,2761074284207359-33 
}; 


I*  Does  not  apply  for  the  case  1  */ 
static  double  num2 [ 1 ] [ 1 ] [ 1 ] =  {i.O); 
static  double  den2  [  1  ]  =  •(  1 . 0) ; 
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*  11  april  1991  * 

*  transferhplinv.txt  (Optimal  case  input  1)  * 

*  Header  file  for  transfer  function  variables  * 

*  Sampling  time  0.02  sec  * 

*  CAPT  D.  Bertrand  * 


**************************************************************************** ^ 

/*  Define  the  case  i  */ 

#define  c  3  /*  X-29  inverse  closed-loop  conf.  structure  */ 


/*  Define  the  variables  */ 


/*  Level 
/def ine 

1  */ 
ordl 

30 

/def ine 

num_in 

1 

/def ine 

reg  vecl 

90 

/define 

num_feed 

89 

/define 

num_comd 

90 

/define 

num_cont 

90 

/def ine 

num  out 

2 

/*  order  of  the  X-29  closed-loop  conf.  */ 

/*  number  of  inputs  to  the  X-29  closed-loop  conf.*/ 
/*  regression  vector  =ord* (num_in+nutn_out)  */ 

/*  feedback  layer  =reg_vec-num_in  */ 

/*  command  layer  =  reg_vec  */ 

/*  control  layer  =  reg_vec  */ 

/*  output  layer  =  num_out  */ 


/*  Level  2  */ 

/define  ord2  30 
/define  num_in2  2 
/define  reg_vec2  90 
/define  num_feed2  88 
/define  num_comd2  90 
/define  num_cont2  90 
/define  num  out2  l 


/*  order  of  the  X-29  inverse  closed-loop  conf.*/ 

/*  number  of  inputs  to  the  X-29  inverse  closed-loop*/ 
/*  regression  vector  =ord* (num_in+num_out)  */ 

/*  feedback2  layer  =  reg_vec-num_out  */ 

/*  command2  layer=  re9_vec  */ 

/*  control2  layer  =  reg  vec  */ 

/*  output2  layer  =  num_In  */ 


/*  Declarations  */ 

static  double  ts={0.02); 
static  double  alphal={ 1 . 0 ) ; 
static  double  alpha2= { 0 . 01 } ; 
static  double  alpha3  =  { 0 . 001 }  ; 

static  char  *input_name[ ]={"Illegal  Input" , "Random  Binary", 

"A  Pulse  input  of  1  degree  for  1  sec  (input  1)"," (input  2)"); 


static  char  *state_name [ ] =( "I llegal  State" , "u (t) ", "alpha (t) " , 
"q(t)",  "theta  (t)"}; 


/*  Numerator  coefficients  of  the  X-29  closed-loop  conf.  •/ 
/*  Order  is  al-a30  &  ql-q30  for  the  indices  */ 

static  double  numl [ 1 ] [ 2 ] [ 30 ] = 

{  7.217941790123916e-03, 

4. 136127382910360e-02 , 

-4.6697689748593526-01, 

1.7409153789107856+00, 

-3.8609720794906376+00, 
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5. 910026001863 51 4e+00, 
-6. 60362 37249056176+ 00, 
5.4618151917355256+00, 
-3.2701589875142366+00, 
1.2766672995943946+00, 
-1.5207540746008876-01, 
-2.0511590497927666-01, 
1.9453455561352856-01, 
-1.0560098407791206-01, 
4.3050248168023056-02 , 
-1.4215644251606826-02 , 
3.8904658137292606-03, 
-8.7538785764993036-04 , 
1 . 5675049676230896-04 , 
-2 . 1084570150820936-05, 
1.9254190959238406-06, 
-9.2765395013213906-08, 
-7.8226921891163826-10, 
3 . 6066584558301456-10, 
-1.7312824376422586-11, 
2.8288302234390876-13, 
-1.0355132454054916-15, 
3.0846254753760786-17, 
6.0876291104632936-20, 
2 . 1887249680313  3  56-3  3 , 
3.0302790642480206-02 , 
-2 . 1766173633113796-01 , 
7.1994185223715596-01, 
-1.4458874688312456+00, 
1,9372324387532566+00, 
-1.7440105851398476+00, 
9.0461910307709566-01 , 
7.5209838389071146-02, 
-6.9429194406558286-01, 
8 . 1801087288916116-01, 
-6.2963512311721816-01, 
3.7152343661376016-01, 
-1.7795723311457856-01, 
7 .1131432158207286-02, 
-2.4033782644765416-02, 
6.8791981660740466-03, 
-1 . 656 1'5090251 4  14  96-03, 
3.3026441202249716-04 , 
-5.3320550035187476-05, 
6.7644476175470786-00, 
-6.4961143581485486-07, 
4.5023811616075626-08, 
-2. 09903 3629 117875e-09, 
5.7059132705020976-11, 
-4.9361960941247396-13, 
-1.4631680352583  936-14  , 
3. 3399213691611596-16, 
-1.6529692951845196-18, 
4 . 5114326681577396-20, 
1 .6184970063670236-31 
); 
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/*  Denominator  coefficients  */ 
static  double  denl[30]= 


{  -8.702573379180253e+00, 

3 . 624 1850549714346+01, 

-9. 63747661 1139380e+01, 

1 . 8409445672474786+02 , 
-2.6919328749661056+02 , 
3.1334255870225126+02, 
-2.9798535445379006+02, 
2.3581629651227126+02, 
-1.5745353225150886+02, 
8.9675902025313426+01 , 
-4.3951246484988496+01, 
1.866251064997256e+01, 
-6.8944632993096026+00, 
2.2180046442304386+00, 
-6.1947360246519416-01 , 
1.4909023924825766-01, 
-3.0558086631192036-02, 
5.2505011205958746-03, 
-7.4179152688470946-04 , 

8. 4 26982 1612815006-05, 
-7.5092279267402486-06, 
5.1054414682252226-07 , 
-2.5590018209305926-08, 
8.9818542939913706-10, 
-2.0244228762992696-11, 
2.5560687541897846-13, 

-1 .8583910836869456-15, 
2.0707848492584016-17, 
-5.2314690227766016-21, 
-8,2038285790876436-38 
}; 


/*  Does  not  apply  for  the  inverse  plant  */ 
static  double  num2 [ 2 ] [ 1 ] [ 30]=  {1.0}; 
static  double  den2 [ 30]  =  { 1 . o }  ; 
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*  6  Sept  1991  * 

*  transferA4inv.txt  * 

*  Header  file  for  transfer  function  variables  * 

*  Sampling  time  0.1  sec  * 

*  Capt  D.  Bertrand  * 


/*  Define  the  case  t  */ 

#define  c  4  /*  A4  inverse  plant  structure  */ 


/*  Define  the  variables  */ 


/*  Level  1  */ 

#define  ordl  4 
/define  num_in  1 
/define  regvecl  20 
/define  num_feed  19 
/define  num_comd  20 
/define  num_cont  20 
/define  num  out  4 


/*  order  of  the  A4  plant  */ 

/*  number  of  inputs  to  the  A4  plant  */ 

/*  regression  vector  =ord* (num_in+num_out)  */ 
/*  feedback  layer  =reg_vec-num_in  */ 

/*  command  layer  =  reg_vec  */ 

/*  control  layer  =  reg_vec  */ 

/*  output  layer  =  num_out  */ 


/*  Level  2  */ 

/define  ord2  4 
/define  num_in2  4 
/define  reg~vec2  20 
/define  num~feed2  16 
/define  num~comd2  20 
/define  num”cont2  20 
/define  num~out2  1 


/*  order  of  the  A4  inverse  plant  */ 

/*  number  of  inputs  to  the  A4  inverse  plant  */ 
/*  regression  vector  =ord* (num_in+num_out)  */ 
/*  feedback2  layer  =  reg_vec-num_out  */ 

/*  command2  layer=  reg_vec  */  ~ 

I*  control2  layer  =  reg  vec  */ 

/*  output2  layer  =  num_In  */ 


/*  Declarations  */ 

static  double  ts={0.1}; 
static  double  alphal={ 1 . 0} ; 
static  double  alpha2= { 1 . 0} ; 
static  double  alpha3={0. 001) ; 


static  char  *input_name[ ]={"Illegal 
"A  Pulse  input  of  1  degree  for  1 


Input" , "Random  Binary", 
sec  (input  1)"," (input  2)"}; 


static  char  *state_name[ ]={"Illegal  State" 
"q(t)",  "theta(t)"}; 


"u(t)","alpha(t)". 


/*  Numerator  coefficients  for  the  A4  plant*/ 

/*  Order  is  ul-u4,  al-a4,  ql-q4  &  tl-t4  for  the  indices  */ 

static  double  numl [ 1 ] [ 4 ] ( 4 ] = 

{ 

2.713068210091762e-05, 
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7 .72475975683 3066e-05, 
-7.0557911008961586-05, 
-2.2579374415077076-05, 
-3.4619286512664446-02, 
4.5022358176790796-02, 
1.3715112596711886-02, 
-2.4124122580810986-02, 
-1.9864497634973786-01, 
5.8002475783296346-01, 
-5.6413669084277416-01, 
1.8275690935954846-01, 
-7.7051804374526086-03, 
7.4781248724349336-03, 
6.9640104111017296-03, 
-6.7386259842884276-03 
}; 

/*  Denominator  coefficients  for  the  A4  plant  */ 

static  double  denlt4]= 

{ 

-3.6949236438548226+00, 

5.1802173047548286+00, 

-3.2754997356482016+00, 

7.9021486125677996-01 

}; 


/*  Does  not  apply  for  the  inverse  plant  */ 
static  double  num2 ( 4 ] [ l ] [ 4 ]=  {0.0}; 
static  double  den2[4]  =  {0.0} ; 
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^««««4««**ii«**ii***«**'k*'k*****««ii««*«**«*************<,«**it******************* 

*  28  july  1991 

*  transferl4inv.txt 

*  Header  file  for  transfer  function  variables 

*  Sampling  time  0.02  sec 

*  CAPT  D.  Bertrand 

* 

**********************i>********«*******ik************************************ 

/*  Define  the  case  #  */ 

/define  c  5  /*  X-29  Inverse  plant  structure  */ 


/*  Define  the  variables  */ 


/*  Level 
/define 

1  */ 
ordl 

14 

/define 

num  in 

1 

/define 

reg_vecl 

42 

/define 

num  feed 

41 

/define 

num  comd 

42 

/def ine 

num_cont 

42 

/define 

num  out 

2 

/*  order  of  the  X-29  Plant  */ 

/*  number  of  inputs  to  the  X-29  Plant  */ 

/*  regression  vector  =ordl*(num  in+num_out)  */ 
/*  feedback  layer  =reg_vec-num_Tn  */ 

/*  command  layer  =  reg_vec  */ 

/*  control  layer  =  reg_vec  */ 

/*  output  layer  =  num_out  */ 


/*  Level  2  */ 

/define  ord2  14 
/define  num_in2  2 
/define  reg~vec2  42 
/define  num_feed2  40 
/define  num_comd2  42 
/define  num_cont2  42 
/define  num~out2  1 


/*  order  of  the  X-29  inverse  plant  */ 

/*  number  of  inputs  to  the  inverse  plant  */ 

/*  regression  vector  =brd2* (num_in+num_out)  */ 
/*  feedback2  layer  =  reg_vec-num_out  */ 

/*  command2  layer*  reg_vec  */ 

/*  control2  layer  =  reg  vec  */ 

/*  output2  layer  *  num_In  */ 


/*  Declarations  */ 

static  double  ts={0.02); 
static  double  alphal={l. 0} ; 
static  double  alpha2={ 0 . 01 } ; 
static  double  alpha3={0. 001} ; 


static  char  *input_name[ ]={"Illegal  Input" , "Random  Binary", 

"A  Pulse  input  of  l  degree  for  1  sec  (input  1)"," (input  2)"}; 

static  char  *state_name[ ]  =  ("Illegal  State" , "alpha  (t) " , 

"q(t)"}; 


/*  Numerator  coefficients  for  the  X-29  plant  */ 


static  double  numl [ l ] [2 ] [ 14  ]  = 

{  -4,056931727527413e-04, 

8. 64 098580123 5956e-04, 
-9.645374778415317e-04 , 
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7. 6687321 34 167300e-04, 
-3.3552033245243256-04, 
2.0029886001138316-05, 
4.4238998446965996-05, 
-2.1346562787558096-05, 
4.2065735563218836-06, 
-2.4148984713746196-07, 
3.9355415863790386-09, 
-1.2967894231467346-09, 
6.0129159664440806-11, 
6.1399281640967636-13, 
-1.4688368679323996-02, 
5.0672390446704806-02, 
-8.1854632869216466-02, 
8.3512058550237366-02, 
-5.8569193127826946-02, 
2.9279294677036606-02, 
-1.0826487659440836-02, 
2.9508043993057706-03, 
-5.6015663871115086-04, 
6.6319582147386306-05, 
-2.0503377488952406-06, 
-1.1759208554143656-07, 
4.2866447336428496-09, 
6.9539856520984976-11 
}; 


/*  D6noiiiinator  co6ffici6nts  for  the  plant  */ 

static  double  deni [14]= 

{  -4.7297394870346236+00, 
9,7565836164208106+00, 
-1.1696450311726986+01, 
9.1799646472286496+00, 
-5.0256974202037616+00, 
1,9789136836746866+00, 
-5.6308387279949586-01 , 
1.1374807687247026-01, 
-1.5542520952154236-02, 
1.3002969428343506-03, 
-5.7374140531447696-05, 
1.0554386798861306-06, 
-4.9245005623733066-09, 
1.1147620008086446-10 
); 


/*  Does  not  apply  for  the  inverse  plant  */ 
static  double  num2 [ 2 ] [ 1 ] [ 14 ] =  {1.0}; 
static  double  den2 [ 14 ]  =  { 1 . 0} ; 
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*  28  july  1991  * 

*  transferl614hp.txt  OPTIMAL  CASE  * 

*  Header  file  for  transfer  function  variables  * 

*  Sampling  time  0.02  sec  * 

*  CAPT  D.  Bertrand  * 

*  * 


**************************************************************************** ^ 

/*  Define  the  case  #  */ 

/define  c  6  /*  controller  and  plant  in  series  (optimal  case)  */ 


/*  Define  the  variables  */ 


/*  Level 

1  * 

/ 

/define 

ordl 

16 

/def ine 

num 

in 

2 

/define 

reg_ 

vecl 

64 

/define 

num_ 

feed 

62 

/define 

num_ 

comd 

64 

/define 

nuin_ 

cont 

64 

/define 

num 

out 

2 

/*  order  of  the  controller  */ 

/*  number  of  inputs  to  the  controller  */ 

/*  regression  vector  =ordl*(num  in+num_out)  */ 
/*  feedback  layer  =reg_vec-num_In  */ 

/*  command  layer  =  reg_vec  */ 

/*  control  layer  =  reg_vec  */ 

/*  output  layer  =  num_out  */ 


/*  Level  2  */ 

/define  ord2  14 
/define  num_in2  2 
/define  reg_vec2  56 
/define  num_feed2  54 
/define  num_comd2  56 
/define  num_cont2  56 
/define  num  out2  2 


/*  order  of  the  plant  */ 

/*  number  of  inputs  to  the  plant  */ 

/*  regression  vector  =ord2* (num_in+num_out)  */ 
/*  feedback2  layer  =  reg_vec-num_out  */ 

/*  command2  layer=  reg_vec  */ 

/*  control2  layer  =  reg  vec  */ 

/*  output2  layer  =  num_Tn  */ 


/*  Declarations  */ 

static  double  ts={0.02); 
static  double  alphal={ 1 . 0} ; 
static  double  alpha2={ 1 . 0} ; 
static  double  alpha3={ 0 . 001 } ; 


static  char  *inDut_name[ ]={"Illegal 
"A  Pulse  input  of  1  degree  for  1 


Input” , "Random  Binary", 
sec  (input  1)"," (input  2)"); 


static  char  *state_name[ ]={"Illegal  State" , "alpha (t) " , 
"q(t)"}; 


/*  Numerator  coefficients  for  the  controller  */ 


static  double  numl [ 2 ] [ 2 ] [ 16  ]  = 

{  -9.859880629593550e+01, 

4 .651873138146647e+02, 
-1.051882 10573088 le+03, 
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1.5191549360444256+03 , 
-1.5579657382846646+03 , 
1.2110428879065086+03, 
-7.4967095499548286+02, 
3.7449737366436396+02, 
-1.4785415537850846+02, 
4.4664341564702946+01, 
-1.0030815222441916+01, 
1.6204045147356076+00, 
-1.7427985729228796-01, 
9.7245754429109286-03, 
-2.0355470711704316-04, 
8.7453880737362356-13, 
-4.3881883266078776+01, 
-4.6161772344680566+01, 
6.3921111456325096+02, 
-1.3974489776545426+03, 
1.5238678104943356+03, 
-9.9796205750514046+02, 
4.1523966065079096+02, 
-1.0614785170366876+02, 
1.2695989039996476+01, 
1.1940805357403616+00, 
-7.0555495581864066-01, 
1.0562836167038496-01, 
-6.3244668860797796-03, 
7.0964633777058476-05, 
3.2811638264335346-06, 
3.8255646255654156-11, 
3.7923622302681616+01, 
-1.8032181874441866+02, 
3.8099354058747836+02, 
-4.8269936361926026+02, 
4.0916419929326756+02, 
-2.3344461811687906+02, 
7.9886658878683386+01, 
-7.0280018653075446+00, 
-8.3038476298062906+00, 
5.2127407207611166+00, 
-1.6978068022496566+00, 
3.6037232942856176-01, 
-4.8731934053275816-02, 
3.1152399861922536-03, 
-7.0522488702395836-05, 
5.9758613932898986-13, 
-2.2443004330868516+01, 
6.3811384115595396+01, 
-1,2960626414400446+01, 
-1.7322617228898016+02, 
3.2018442750301606+02, 
-2.8774866452384896+02, 
1.5539708089197186+02, 
-5.2636328048419006+01, 
1.0524248512436186+01, 
-8.0522296818598266-01, 
-1,2948341683225486-01, 
3,4910011173144706-02, 
-2.6216488459012276-03, 
4.3696750470974786-05, 
1.0847036809188906-06, 


2.6140685535577226-11 

}; 

/*  Denominator  coefficients  for  the  controller  */ 

static  double  deni [16]= 

{  -4.1341127630674156+00, 

7.9520365353432856+00, 
-9.679222466663568e+00, 

8.2647550041397516+00, 

-5.156472050247617e+00, 

2.466202573916116e+00, 

-9.5266517425434446-01, 

3.0438041721910356-01, 

-7.809450273438016e-02, 

1.5076574094 31068e-02, 
-2.0628783920035976-03, 

1.8782874447945986-04 , 
-9.267211620365389e-06, 

1.7768618716515436-07, 

-4.6929025094272736-11, 

-3.1038184693712396-28 

}; 

/*  Numerator  coefficients  for  the  plant  */ 


static  double  num2[2] [2] [14]= 

{  -3.5852630806409996-05, 

-2.7778074505491196-05, 
4.5395249910917816-04, 
-5.9584203223472806-04, 
2.6649951238866276-04, 
-5.610107617126658e-06, 

-4 . 1884699247929376-05, 
1.8570953020630176-05, 
-3.4540004723859766-06, 

2. 192568109666768e-07, 
3.8195568332187616-09, 
-4,2688544295909676-10, 
-2.6551107148602406-13, 
-5.1189541680888736-14, 
-7.5133471864763386-04 , 
8.5619911556999996-03, 
-1.2779788559322826-02, 
1.1814762792656816-03, 
8.8789870056933406-03, 
-7.4860107028278396-03, 
2.9889383815875366-03, 
-6,4184789044964556-04 , 
5.7427948750960266-05, 
1.3819400299058646-06, 
-4.9718366255934876-07, 
1.8013235080108276-08, 
-2.8141703739260856-11, 
2.0839600442777046-12 , 
-4.0569317275274136-04, 
8.6409858012359566-04 , 
-9.6453747784153176-04 , 
7.6687321341673006-04 , 
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-3.3552033245243256-04, 

2.0029886001138316-05, 

4.4238998446965996-05, 

-2,1346562787558096-05, 

4.2065735563218836-06, 

-2.4148984713746196-07, 

3.9355415863790386-09, 

-1.2967894231467346-09, 

6.0129159664440806-11, 

6.1399281640967636-13, 

-1.4688368679323996-02, 

5.0672390446704806-02, 

-8.1854632869216466-02, 

8.3512058550237366-02, 

-5.8569193127826946-02, 

2.9279294677036606-02, 

-1.0826487659440836-02, 

2.9508043993057706-03, 

-5.6015663871115086-04, 

6.6319582147386306-05, 

-2.0503377488952406-06, 

-1.1759208554143656-07, 

4.2866447336428496-09, 

6.9539856520984976-11 

}; 


/*  D6noininator  co6f£ici6nts  for  th6  plant  */ 

static  doubl6  d6n2[14]= 

{  -4.7297394870346236+00, 
9.7565836164208106+00, 
-1.1696450311726986+01, 

9. 1799646472286496+00, 
-5.0256974202037616+00, 
1.9789136836746866+00, 
-5.6308387279949586-01, 
1.1374807687247026-01, 
-1.5542520952154236-02, 
1.3002969428343506-03, 
-5.7374140531447696-05, 
1.0554386798861306-06, 
-4.9245005623733066-09, 
1.1147620008086446-10 
}; 
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*  28  july  1991  * 

*  transferl6141ini.txt  LIMITED  CASE  * 

*  Header  file  for  transfer  function  variables  * 

*  Sampling  time  0.02  sec  * 

*  CAPT  D.  Bertrand  * 

*  * 


***********************************«*****************************4*******4**y 

/*  Define  the  case  #  */ 

/define  c  7  /*  controller  and  plant  in  series  (limited  case)  */ 


/*  Define  the  variables  */ 


/*  Level 
/define 

1  */ 
ordl 

16 

/define 

num_in 

2 

/define 

regvecl 

64 

/def ine 

num_f eed 

62 

/def ine 

num_comd 

64 

/def ine 

num_cont 

64 

/def ine 

num  out 

2 

/*  order  of  the  controller  */ 

/*  number  of  inputs  to  the  controller  */ 

/*  regression  vector  =ordl*(num  in+num_out)  */ 
/*  feedback  layer  =reg_vec-num_Tn  */ 

/*  command  layer  =  reg_vec  */ 

/*  control  layer  =  reg_vec  */ 

/*  output  layer  =  numout  */ 


/*  Level  2  */ 

/define  ord2  14 
/define  num_in2  2 
/define  reg3vec2  56 
/define  num”feed2  54 
/define  num~comd2  56 
/define  num~cont2  56 
/define  num”out2  2 


/*  order  of  the  plant  */ 

/*  number  of  inputs  to  the  plant  */ 

/*  regression  vector  =ord2* (num_in+num_out)  */ 
/*  feedback2  layer  =  reg_vec-num_out  *~j 
/*  command2  layer=  reg_vec  */ 

/*  control2  layer  =  reg  vec  */ 

/*  output2  layer  =  num_Tn  */ 


/*  Declarations  */ 

static  double  ts={0.02}; 
static  double  alphal=( 1 . 0} ; 
static  double  alpha2={ 1 . 0} ; 
static  double  alpha3={0.001}  ; 

static  char  *lnput_name []  =  {'' Illegal  Input", 

"A  Pulse  input  of  1  degree  for  1  sec  (input  1)"," (input  2)"}; 

static  char  *state_name[ ]={"Illegal  State" , "alpha (t) " , 


/*  Numerator  coefficients  for  the  controller  */ 


static  double  numl(2] [2] (16]= 

{  -2.4797111403480806-01, 

1.388546204672132e+00, 
-3.5467724050833246+00, 
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5.5655784280167576+00, 
6.0958820900954446+00, 
4.9854473534673086+00, 
3.1465991113017406+00, 
1.5546756607724836+00, 
6.0599106459555776-01, 
1.8640476524596346-01, 
4.4370745092195466-02, 
7.7953547570269776-03, 
9.1445710994212366-04, 
5.4424295430137516-05, 
1.2053760350606776-06, 
4.0260487293601746-10, 
2.6136583946409166-01, 
1.1800693539174216+00, 
2.1585476483223196+00, 
1.9972458924404896+00, 
8.9794748791527476-01, 
7.1499163753880886-02, 
1.1166093732793316-01, 
5.0835904165427166-02 , 
8.4597596711031296-03, 
2.9478170972507826-04, 
1.1818012947945046-04 , 
5.2709693022696266-05, 
1.4646158320961486-05, 
6. 3128476606535196-06, 
6.0061352343439736-07, 
1.6813533151036456-08, 
2.5365361005274256-01, 
1 . 5646609647900826+00, 
4.3603505476537346+00, 
7.3030316255803676+00, 
8.2523249115736206+00, 
6.6952211689850646+00, 
4.0526596672845346+00, 
1.8771826674140606+00, 
6.7546259228665976-01 , 
1.8913906377200036-01, 
4.0502259118855806-02, 
6.3380096932894736-03 , 
6.5456925237681676-04, 
3.5377244662115126-05, 
7.2023272649793686-07, 
4.8301768520174136-10, 
3.4833095009924266-01, 
1.7834289127518526+00, 
3.8195462312038306+00, 
4.3332271592901756+00, 
2.5662707366734816+00, 
3.5127415340949856-01, 
6.4417420081684906-01, 
5.7133350988250086-01, 
2.5038421474336576-01, 
6.6743508204411996-02, 
1.0435718748775506-02, 
6.4461552719701646-04, 
6.9604918921874386-05, 
1.5759720116591126-05, 
9.8356408479502346-07, 


2.0171722720198886-08 

}; 

/*  Denominator  coefficients  for  the  controller  */ 

static  double  denl[16]= 

{  -6.625803214724185e+00, 

1.9874809463910116+01, 
-3.5981992088592636+01, 

4.4329446197998126+01, 

-3.9799190392568406+01, 

2.7229516704744206+01, 

-1.4619911405588156+01, 

6.2679215847380756+00, 

-2.1602556817239396+00, 

5.9478023178755476-01, 

-1.2748730200137566-01, 

2.0175210319411726-02, 

-2.1240313407768596-03, 

1.1718292839558426-04 , 
-2.4598862425486576-06, 

1.3538895901687056-22, 

}; 


/*  Numerator  coefficients  for  the  plant  */ 


static  double  num2 [ 2 ] [ 2 ] ( 14 ]= 

{  -3.5852630806409996-05, 

-2.7778074505491196-05, 
4.5395249910917816-04 , 
-5.9584203223472806-04, 
2.664995123886627e-04, 
-5.6101076171266586-06, 
-4,1884699247929376-05, 
1.8570953020630176-05, 
-3.4540004723859766-06, 
2.1925681096667686-07, 
3.8195568332187616-09, 
-4.2688544295909676-10, 
-2.6551107148602406-13, 
-5.1189541680888736-14, 
-7.5133471864763386-04 , 
8.5619911556999996-03 , 
-1.2779788559322826-02, 
1.1814762792656816-03, 
8.8789870056933406-03, 
-7.4860107028278396-03, 
2,9889383815875366-03, 
-6.4184789044964556-04 , 
5.7427948750960266-05, 
1.3819400299058646-06, 
-4.9718366255934876-07, 
1.8013235080108276-08, 
-2.8141703739260856-11, 
2.0839600442777046-12, 
-4.0569317275274136-04 , 
8.6409858012359566-04 , 
-9.6453747784153176-04, 
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7. 6687 32 1341673006-04 , 
-3.3552033245243256-04, 
2.0029886001138316-05, 
4.4238998446965996-05, 
-2.1346562787558096-05, 
4.2065735563218836-06, 
-2.4148984713746196-07 , 
3.9355415863790386-09, 
-1.2967894231467346-09, 
6.0129159664440806-11, 
6.1399281640967636-13, 
-1.4688368679323996-02, 
5.0672390446704806-02, 
-8.1854632869216466-02, 
8.3512058550237366-02, 
-5.8569193127826946-02, 
2.9279294677036606-02, 
-1.0826487659440836-02, 
2.9508043993057706-03 , 
-5.6015663871115086-04 , 
6.6319582147386306-05, 
-2.0503377488952406-06, 
-1.1759208554143656-07, 
4.2866447336428496-09, 
6.9539856520984976-11 


/*  D6noininator  co6fficients  for  th6  plant  */ 

static  doubl6  d6n2[14]= 

{  -4.7297394870346236+00, 
9.7565836164208106+00, 
-1.1696450311726986+01, 
9.1799646472286496+00, 
-5.0256974202037616+00, 
1.9789136836746866+00, 
-5.6308387279949586-01, 
1.1374807687247026-01, 
-1.5542520952154236-02, 
1.3002969428343506-03, 
-5.7374140531447696-05, 
1,0554386798861306-06, 
-4.9245005623733066-09, 
1.1147620008086446-10 
}; 
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APPENDIX  D:  MATLAB  M-FILES 


%  contdiscliml .m 
%  input  f iles: . . .hinf lim.mat 

%  output  f  iles; ..  .tfliinl/2  .mat,  contdisclinl/2/a/q.iBet,  trueliml/2/a/q.mat 


%"THIS  M-FILE  CREATES  DISCRETE  &  CONTINUOUS  BODE  PLOTS  FOR  THE  PLANT 
%  STATE  REPRESENTATION  OF  Hinf  LIMITED  PERFORMANCE  X-29  model,  CASE  #2. 
%  Altitude  =  30000  feet 
%  Mach#  =  .5 


%  The  A,B,C  and  D  matrices  are  first  balanced  to  measure  a  reasonable  condition 
%  number  for  the  A  matrix,  then  converted  from  a  continuous  to  a  discrete  state 
%  space  model  using  Ts=0.02  sec  as  the  sampling  time,  and  finally  converted  to 
%  a  transfer  function  form  using, 

% 

%  H(2)=  C*inv(zI-A)*B=  Y(z)/U(2)  (1) 

% 

t  By  replacing  the  z-transform  with  the  1/q  backward  shift  operator,  the 
%  numerator  and  denominator  terms  of  that  transformation  may  be  used  to  obtain 
%  the  DARMA  model, 
t 

%  A(q)y{t)  =  B(q)u(t)  (2) 

% 

%  Reworking  equation  (2)  gives  [Ref.  7:pp.  71-72], 

t 

%  y(t)  =  B{q)u(t)  -  (A(q)  -  l)y(t)  (3) 

% 

%  Expanding  the  matrix  polynomials  and  rearranging  it  to  obtain  two  recursive 
I  equations  of  the  form  similar  to  equation  (3.8)  of  Chapter  III  gives, 

« 

%  Yi(t)  =  SUMj[Bij*Uj (t-j)  -  SUMj[Aj*Yj(t-j) ]  (4) 

% 

%  where  SUM  indicates  a  summation  operation 

%  i  indicates  the  number  of  outputs 

%  j  indicates  the  number  of  past  input  and  output  measurements 

%  Aj  terms  are  the  denominator  coefficients 

I  Bij  terms  are  the  numerator  coefficients 

t 

%  The  algorithm  referring  to  the  control  input  in  USERIO  of  the  case  request 
I  RQLEARNRSLT  of  Appendix  A,  is  represented  by  equation  (4).  Control  [j] 

%  specifies  the  first  30  elements  of  the  control  layer,  which  are  the  past  30 
%  inputs,  [Uj(t-j)],  whereas  control  (30*(i+l)+j]  specifies  the  second  and  the 
I  third  block  of  30  elements,  which  are  the  past  30  outputs,  [Yj(t-j)],  for 
%  each  of  the  two  ouput  elements. 

I  Finally,  the  coefficients  for  B(q)  and  A(q)-1  matrices  of  equation  (3) 

%  are  represented  in  the  Transfer. h  files  as  the  numerator  and  denominator 
t  coefficients  for  both  cases.  Optimal  and  Limited  performance. 


\  get  the  a,b,c  &  d  matrices 

load  hinflim.mat 

a=acgf ; 
b=bcgf ; 
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c=ccgf ; 
d=dcgf ; 

%  balance  a  ,b  and  c  matrices. 
[ab,bb,cb,g,t]=obalreal (a,b,c) ; 

%  compute  continuous  Bode 

disp('  calculating  continuous  Bode  please  wait') 

w=logspace (-3,2,1024); 
(magc,phasec)=bode{ab,bb,cb,d, l,w) ; 
mag=20*logl0 (mag) ; 

%  Compute  discrete  time  system 
t=.02;  %  SAMPLING  TIME 

[ad,bd]=c2d(ab,bb,t) ; 


I  Compute  transfer  function  for  the  two  inputs 

[numl ,denl ]=ss2tf (ad, bd, cb,d, 1) ; 

(num2 ,den2  J=ss2tf (ad, bd, cb, d, 2) ; 


%save  tfliml  numl  deni 
%save  tflim2  num2  den2 


%  Discrete  Bode  plot  calculations 
disp( ' ' ) 

disp('  calculating  discrete  Bode  Nyquist  SOHz  T=.02  ') 


[ mag, phase ]=dbode (ad, bd,cb,d, l,w) ; 
loglog(w,magc( : , 1) , 50*w,mag( : , 1) ) 

title ('X-29  Continuous  and  Discrete  Alpha  Frequency  Response') 
title!'  Optimal  case  -  input  1  ') 

xlabel ( 'Altitude  =  30000  feet  frequency  (Hz)  Mach  =.5'), 

ylabel ! 'magnitude  ') 

text (0.01, .0001, 'continuous  _ ') 

text !.  01 ,. 00001 , 'discrete - ') 

meta  contdisclimla 
pause 


loglog (w , mage ( : , 2 ) , 50*w , mag ( : , 2 ) ) 

title ('X-29  Continuous  and  Discrete  Q  Frequency  Response  ') 
title ('  Optimal  case  -  input  2  ') 

xlabel ( 'Altitude  =  30000  feet  frequency  (Hz)  Mach  =.5'), 

ylabel ! 'magnitude  ') 

text (0. 1, .001, 'continuous  _ ') 

text !. 1 ,. 0003 , 'discrete  - ') 
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meta  contdisclimlq 


f=w; 

in=inag  ( : ,  1) ; 

%save  truelimla  f  m 

in=niag(:  ,2)  ; 

tsave  truelimlq  f  m 
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%  wgtm.m 


%  This  matlab  file  calculates  the  SVD  of  the  weight  matrices, 

%  which  are  composed  of  the  connections  weights  between  the 
%  two  hidden  layers.  The  first  hidden  layer  has  42  elements 
%  and  the  second  hidden  layer  has  been  tested  with  30,  21, 

%  12,  8  and  5  elements. 

%  The  input  .nnp  files  are  from  the  optimal  controller  network  1 
%  of  case  #6  or  case6h2.nnd. 


load  c6h230.nnp 
load  c6h221.nnp 
load  c6h212.nnp 
load  c6h28.nnp 
load  c6h251.nnp 
load  c6h22.nnp 

[m,nl]=size(c6h230) ; 
[m,n2]=size(c6h221) ; 

[m, n3 ]=size (c6h212 )  ; 
[m,n4j=size(c6h28) ; 
[m,n5]=size(c6h26l)  ; 
[m,n6]=size(c6h22) ; 

tfl=c6h230(; ,3:nl)  ; 
tf2=c6h221(: ,3;n2)  ; 
tf3=c6h212 ( ; , 3 :n3)  ; 
tf 4=c6h28 ( : , 3 :n4)  ; 
tf5=c6h251 ( : ,3:n5) ; 
tf6=c6h22(; ,3:n6) ; 

t=0 : 100; 9900; 

al=zeros( (nl-2) /30, 30)  ; 
a2=zeros ( (n2-2) /21 , 21)  ; 
a3=zeros( (n3-2) /12, 12)  ; 
a4=zeros ( (n4-2) /8 , 8)  ; 
a5=zeros( (n5-2) /5, 5)  ; 
a6=zeros( (n6-2) /2,2)  ; 


for  i=l 

m 

al( 

)=tfl(i,:); 

sl( 

,i)=svd(al) ; 

a2( 

)=tf2(l,:); 

s2( 

, i)=svd(a2) ; 

a3( 

)=tf3(i, ;) ; 

s3( 

,i)=svd(a3) ; 

a4( 

)=tf4(i, :) ; 

s4( 

,i)=svd(a4) ; 

a5( 

)=tf5(i, :) ; 

s5( 

,i)=svd(a5) ; 

a6( 

)=tf6(i, :) ; 

s6  ( 

,i)=3vd(a6) ; 

end; 


i=find(sl<.6) ; 
sl(i)=zeros(i) ; 
i=f ind(s2<. 54) ; 


%  Load  the  .nnp  files. 


%  Obtain  the  size  of  each  matrix. 


%  Get  rid-off  the  first  two  elements. 


%  Time  vector. 

%  Divide  the  matrix  into  blocks  of  which 
%  the  number  of  columns  equals  the  number 
%  of  elements  in  the  second  hidden  layer. 


%  Calculate  the  actual  SVD's. 


%  Get  rid-off  the  insignificant  values. 
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s2(i)=zeros(i)  ; 
i=find{s3<.45)  ; 
s3 (i)=2eros(i) ; 
i=f ind (s4< . 39)  ; 

84 (i)=zeros(i) ; 
i=£ind(s5<.35)  ; 
s5(i)=zeros(i) ; 
i=find(s6<. 30) ; 
s6(i)=zeros(i) ; 

axis((0  10000  0.1  6]) 

plot(t,sl' , 

title('SVD  plot  of  the  wgt  matrix  (hidden  2 

xlabel ( 'Number  of  Epochs') 

ylabel ( 'SVD' ) 

meta  svd41 

pause 

plot(t,s2','-') 

title('SVD  plot  of  the  wgt  matrix  (hidden  2 

xlabel ( ' Number  of  Epochs ' ) 

ylabel ('SVD') 

meta  svd42 

pause 

plot(t,s3','-') 

title ('SVD  plot  of  the  wgt  matrix  (hidden  2 

xlabel ( 'Number  of  Epochs') 

ylabel( 'SVD' ) 

meta  svd43 

pause 

plot(t,s5' , 

title('SVD  plot  of  the  wgt  matrix  (hidden  2 

xlabel ( 'Number  of  Epochs') 

ylabel('SVD') 

meta  svd44 

pause 


plot(t,s6' , '-') 

title('SVD  plot  of  the  wgt  matrix  (hidden  2 

xlabel ( 'Number  of  Epochs') 

ylabel ('SVD') 

meta  svd45 

pause 


-  30  elements)') 


-  21  elements)') 


-  12  elements)') 


-  5  elements)') 


-  2  elements)') 
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%  spcallim.m 

%  input  files: .. .inputliml/a.nnp,  plantliDl/2 .nnp 
\  output  files: ..  .specliinl/2. mat 


%  THIS  M-FILE  CREATES  THE  SPECTRUM  RETURNS  OF  CASE  #2  OF  BOTH  INPUTS 
%  WITH  A  5  ARRAYS  FUNCTION  P= [ Pxx , Pyy , Pxy , Txy , Cxy ]  WHERE  Txy  IS  THE 
%  COMPLEX  TRANSFER  FUNCTION  FROM  X  TO  Y.  P=SPECTRUM (X, Y ,M)  WHERE  X=  INPUT 
%  VECTOR,  Y=OUTPUT  VECTOR,  AND  M=2048  PTS,  WHICH  DIVIDES  BOTH  VECTORS  INTO 
%  SECTIONS  OF  2048  POINTS  EACH. 

%  PERFORM  SPECTRAL  ANALYSES  ON  THE  TWO  SEQUENCES  X  AND  Y. 


load  input liml .nnp 
load  plantliml .nnp 
load  inputlim2 .nnp 
load  plantlim2 . nnp 

xl=inputliml (1:2049,3)  ; 
yl=plantliml(l:2049,3)  ; 
zl=plantliml (1:2049, 4)  ; 
x2=inputlim2  (1:2049, 3)  ; 
y2=plantlim2  (1:2049, 3)  ; 
z2=plantlim2  (1:2049,4)  ; 

clear  inputliml  pdantliml  inputlim2  plantlim2 
disp(l) 

Pal=spectrum(xl ,yl, 2  04  8 , 1024)  ; 
disp(2) 

Pql=spectrum(xl , zl , 2048 , 1024 )  ; 
disp(3) 

Pa2=spectrum(x2 ,y2 ,2048 , 1024)  ; 
disp(4) 

Pq2=spectrum(x2 , z2 , 2048 , 1024 ) ; 

save  specliml  Pal  Pql; 
save  speclim2  Pa2  Pq2 ; 
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%  splotsliml .m 

%  input  files:  . .  .specliinl/2  .mat,  trueliinl/2/a/q.inat 
t  output  files:...  TFliml/2/a/q.met 

%  THIS  M-FILE  COMPARES  THE  SYSTEM  AND  NETWORK  ALPHA  AND  Q  "FREQUENCY"  RESPONSES 
%  FOR  CASE  #2  (LIMITED  CASE)  WITH  RESPECT  TO  THE  TWO  INPUTS. 


load  specliml; 
load  speclim2; 

[n,m]  =  size (Pal)  ; 
Fs=100; 

fl  =  (l:n-l) /n*Fs/2; 


load  truelimla; 

loglog(pi*fl,abs(Pal(2:n,4) ) ,50*f ,m) 

title ('Txy  -  Transfer  function  for  Alpha  (Limited  case  -input  1)') 
xlabel('  Altitude=  30,000  feet  frequency (hz)  Mach=  0.5  ') 

ylabel ( 'Magnitude' ) 

text ( 1 . 0 ,. 001 , 'True  system  - ') 

text  (1 . 0 ,.  0005 ,' 40)c  cycles  _ ') 

meta  TFlimal 
pause 


load  truelimlq; 

loglog(pi*f 1 , abs (Pql (2 : n, 4 ) ) , 50*f ,m) ,  ... 

title ('Txy  -  Transfer  function  for  Q  (Limited  case  -input  1)') 
xlabel('  Altitude=  30,000  feet  frequency (hz)  Mach=  0.5  ') 

ylabel ( 'Magnitude' ) 

text (0.3, .02, 'True  system  - ') 

text(0.3, .008, '40k  cycles  _ ') 

meta  TFlimql 
pause 

load  truelim2a; 

loglog (pi*f 1 ,abs (Pa2(2;n,4)),50*f,m) 

title('Txy  -  Transfer  function  for  Alpha  (Limited  case  -input  2)') 
xlabel('  Altitude=  30,000  feet  frequency (hz)  Mach=  0.5  ') 

ylabel ( 'Magnitude' ) 

text ( 1 . 0 ,. 001 , 'True  system  - ') 

text(1.0, .0005, '40k  cycles  _ ') 

meta  TFlima2 
pause 


load  truelim2q; 

loglog(pi*f 1 ,abs (Pq2(2:n,4)),50*f,m),  ... 

title('Txy  -  Transfer  function  for  Q  (Limited  case  -input  2)') 
xlabel('  Altitude=  30,000  feet  frequency (hz)  Mach=  0.5  ') 

ylabel ( 'Magnitude' ) 

text (0 . 3 , . 02 , 'True  system - ') 

text(0.3, .008, '40k  cycles  _ ') 

meta  TFlimq2 
pause 


181 


%  liml.m 

I  input  f iles: . . .hinf lim.mat,  stepliml/2 . nnp 
%  ouput  files: ...  liinl/2/a/q. met 


%  THIS  M-FILE  COMPARES  THE  SYSTEM  AND 
%  CASE  #2  (LIMITED  CASE)  WITH  RESPECT 

load  hinflim.mat 
load  steplimi.nnp 
load  steplim2.nnp 
format  long  e 


NETWORK  ALPHA  &  Q  "TIME"  RESPONSE  FOR 
TO  THE  TWO  INPUTS. 


wl=stepliml(l;251,3) ; 
zl=stepliml(l:251,4)  ; 
w2=steplim2 (1:251, 3)  ; 
z2=steplim2 (1:251,4)  ; 


clear  stepliml  steplim2 

timel= [ 0 : 0 . 02 : 5) ;  %  for  the  network  response 


%  ul-  input  1  and  u2-  input  2. 

ul= [ ones (1, 101)  zeros (1,300) ; zeros (1,401) )'; 

u2-[2er os (1,401) ;ones (1,101)  zeros (1 , 300) ) ' ; 

[yl]=lsim(acgf ,bcgf ,ccgf ,dcgf ,ul,timel) ; 
[y2]=lsim(acgf ,bcgf ,ccgf ,dcgf ,u2,tirael) ; 


plot(timel,yl(: ,1) ,timel,2l) 
title ('X-29  DESIRED  AND  ACTUAL  ALPHA 
xlabel('TlME  -  SEC') 
ylabel( 'DEGREES') 

text(l. 75, .6, 'Desired  - ') 

text(.5, .12, 'Actual  - ') 

grid 

Imeta  limla 
pause 


RESPONSE  (limited  case  -Input  1)') 


plot(timel,yi ( : ,2) ,timel,wl) 

title('X-29  DESIRED  AND  ACTUAL  Q  RESPONSE (limited  case  -input  1)') 
xlabel('TIME  -  SEC')  -I'-Fui.  x!  ) 

ylabel ( 'DEGREES' ) 
text(l. 75, .6, 'Desired  — ') 

text (.5, .12, 'Actual  - ') 

grid 

Imeta  limlq 
pause 


plot(timel,y2(: ,1) ,timel,22) 
title ('X-29  DESIRED  AND  ACTUAL  ALPHA 
xlabel('TIME  -  SEC') 
ylabel ( 'DEGREES' ) 

text (1.7 5, .6, 'Desired  - ') 

text (.5, .12, 'Actual  - ') 

grid 

Imeta  lim2a 
pause 


RESPONSE  (limited  case  -input  2)') 
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plot  (tiitiel  ,y2  ( : ,  2)  ,  timel ,  w2) 

title ('X-29  DESIRED  AND  ACTUAL  Q  RESPONSE ( limited  case  -input  2)') 
xlabel('TIHE  -  SEC' ) 
ylabel(' DEGREES') 

text(l. 75, .6, 'Desired  - ') 

text( .5, . 12, 'Actual  - ') 

grid 

%meta  lim2q 
pause 
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APPENDIX  E:  TABLE  OF  CONFIGURATIONS  AND  CASES 


Configuration 

c 

a 

s 

€ 

# 

_ 

Model  Structure 

Level  1  Level  2 

Control 

Strategy 

Header  File 

Simulation  of  thf 
X-29  Ctosfd-Loop 
Plant 

MIMO 

(Optimal) 

n/a 

contstil 

Transfer  30hp 

2 

MIMO 

(Limited) 

n/a 

contsul 

Transfer  301im 

Idenlif  of  the 
Inverse  Plant 

3 

SIMO 
(case  * ••  1 ) 

MISO 

(inv.  case  *1) 

contstrl  SlI 

Transferhplinv 

SIMO 
(A4  Plant) 

•  • 

MISO 

(A4inv.Plant) 

contsul  Sl2 

TranstetA4inv 

5 

SIMO 
(x-29  Plant) 

••• 

MISO 

(x29Inv.PUn) 

contstrl  Si  2 

Transferl4inv 

Simulation  of  the 
Existing  Controllers 
and  the  Plant 

6 

MIMO 

(X-29cont.) 

(Optimal) 

MIMO 
(X-29  plant) 
(Optimal) 

contsu2 

lransferl6)4hp 

MIMO 

(X-29cont.) 

(Limited) 

MIMO 
(X-29  plant) 
(Limited) 

contslr2 

Iransferl6l4lim 

1 _ 

8 

•  ••• 

Part  I:  closure  of  the  open-loop  model  of  case  #6 

Pan  11:  closure  of  the  open-loop  model  of  case  «7 

•  30th  order  X-29  transfer  function  whose  inverse  is  stable. 

••  4th  order  A-4D  plant  whose  inverse  is  unstable. 

I4th  order  X-29  plant  whose  inverse  is  very  unstable 
The  closure  implies  the  connection  in  series  of  the  controller  and  the  plant, 
and  the  intrusion  of  the  negative  feedback  loop  of  gain  I  from  the  plant 
outputs  to  the  controller  inputs. 
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